00000001:02000400:0.0F:1788837132.168687:0:2969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788837150.803945:0:3190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788837153.044864:0:3233:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 463 MB/s 00000001:01000000:3.0F:1788837153.297190:0:3233:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 515 MB/s 00000001:01000000:2.0:1788837153.547587:0:3233:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2879 MB/s 00000020:02000000:3.0:1788837154.776035:0:3282:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_113_gf5ca795 00000400:02000000:1.0F:1788837155.907709:0:3297:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.143@tcp [8/256/0/180] 00008000:02000000:3.0:1788837159.511489:0:3446:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788837209.262596:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788837217.943500:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788837217.943505:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788837217.943615:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007e646ccb 00000080:02000400:1.0:1788837217.943623:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788837217.947354:0:5825:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788837217.947366:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788837217.947401:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000b9d565c) 00000020:00000080:1.0:1788837217.947421:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788837217.961504:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788837217.961953:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788837217.979692:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788837217.979733:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788837217.979841:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788837217.979896:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788837217.979921:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788837217.980247:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788837217.980255:0:5825:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788837217.980265:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be305076 00000020:01000004:2.0:1788837217.980271:0:5825:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788837217.980729:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788837217.980735:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007e646ccb from MGS 00000020:01000004:2.0:1788837217.980805:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788837217.980830:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000043d187f8) 00000020:00000080:2.0:1788837217.980841:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788837217.980928:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007e646ccb from MGS, refs=2 00080000:01000000:2.0:1788837217.980934:0:5825:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788837217.980938:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be305084 00000100:00100000:2.0:1788837217.981027:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788837217.981165:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788837217.981171:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788837217.982591:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788837217.982601:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788837217.983592:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837217.983868:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788837217.983874:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788837217.985575:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788837217.985586:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788837217.987559:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788837217.987571:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788837217.988744:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837217.988749:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837217.988751:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837217.989839:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837217.989842:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837217.989844:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837217.990622:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788837217.991687:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788837218.240454:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5507 MB/s 00000001:01000000:3.0:1788837218.490416:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5355 MB/s 00000001:01000000:2.0:1788837218.742887:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 960 MB/s 00000001:01000000:1.0:1788837218.994507:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 623 MB/s 00080000:10000000:2.0:1788837219.003724:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788837219.031110:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788837219.031124:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788837219.031127:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788837219.039575:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788837219.040647:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788837219.040726:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788837219.045392:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788837219.045454:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788837219.045768:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837219.045967:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788837219.045973:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788837219.049152:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788837219.049162:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:0.0:1788837219.051365:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837219.051983:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788837219.051993:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788837219.056073:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:2.0:1788837219.056436:0:5840:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1788837219.056478:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.143@tcp' 00000020:01000004:3.0:1788837219.056481:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788837219.058597:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.143@tcp (typ=mgc) 00000020:00000080:3.0:1788837219.058627:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.143@tcp (0000000017bf63e7) 00000020:00000080:3.0:1788837219.058646:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788837219.058772:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005e22c208@MGC192.168.203.143@tcp: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1788837219.058940:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.143@tcp-0 is initialized 00000040:01000000:3.0:1788837219.058946:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788837219.059413:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788837219.059476:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.143@tcp (uuid 30a8965a-c42f-4c1b-a594-94749f11bd0b) 00000020:00000080:2.0:1788837219.059490:0:5825:0:(genops.c:1385:class_connect()) connect: client 30a8965a-c42f-4c1b-a594-94749f11bd0b, cookie 0x843cbef8be305092 00000100:00080000:2.0:1788837219.059500:0:5825:0:(import.c:510:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837219.059504:0:5825:0:(import.c:624:import_select_connection()) MGC192.168.203.143@tcp: import 000000005e22c208 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1788837219.059541:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006889ecca x1875731708641408/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837219.059568:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 30a8965a-c42f-4c1b-a594-94749f11bd0b->MGS 00000020:01000004:2.0:1788837219.059585:0:5825:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788837219.059589:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788837219.059597:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000062a03219) 00000020:00000080:2.0:1788837219.059605:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788837219.063046:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006889ecca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30a8965a-c42f-4c1b-a594-94749f11bd0b:3312:1875731708641408:0@lo:250: 00000100:00100000:3.0:1788837219.063176:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837219.071433:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708641408 00000100:00100000:3.0:1788837219.071447:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708641408 00000100:00100000:3.0:1788837219.071494:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837219.071500:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dec3c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1875731708641408:12345-0@lo:250: 00010000:00080000:3.0:1788837219.071532:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 30a8965a-c42f-4c1b-a594-94749f11bd0b@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:3.0:1788837219.071559:0:5837:0:(genops.c:1385:class_connect()) connect: client 30a8965a-c42f-4c1b-a594-94749f11bd0b, cookie 0x843cbef8be3050a0 00000100:00080000:3.0:1788837219.071681:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000295e5c97 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837219.071759:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dec3c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:3312:x1875731708641408:12345-0@lo:250: Request processed in 258us (8582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837219.071767:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837219.071806:0:3312:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788837219.071814:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.143@tcp: connect to target with instance 0 00000100:00080000:3.0:1788837219.071820:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788837219.071826:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788837219.071828:0:3312:0:(import.c:65:import_set_state_nolock()) 000000005e22c208 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788837219.071830:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788837219.071838:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788837219.071842:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006889ecca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30a8965a-c42f-4c1b-a594-94749f11bd0b:3312:1875731708641408:0@lo:250: 00000100:00100000:2.0:1788837219.083702:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837219.083936:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788837219.083943:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788837219.084966:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788837219.084981:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788837219.085407:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788837219.085414:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788837219.086015:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837219.086516:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788837219.086522:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788837219.095356:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788837219.095369:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788837219.134609:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837219.134851:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788837219.134857:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788837219.137473:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788837219.137502:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788837219.138562:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837219.138758:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788837219.138764:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788837219.139635:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788837219.139650:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788837219.140461:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837219.140639:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788837219.140644:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788837219.141247:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788837219.141255:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788837219.148865:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837219.149063:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788837219.149070:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788837219.149820:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788837219.149828:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788837219.178968:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837219.179528:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788837219.179536:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788837219.181426:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788837219.181440:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788837219.182041:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788837219.182049:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788837219.183676:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788837219.183702:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788837219.183709:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788837219.183856:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788837219.183902:0:5825:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788837219.183906:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788837219.183908:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837219.183909:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837219.183910:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837219.183911:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837219.183913:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837219.183914:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837219.183916:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837219.183917:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837219.183918:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837219.183920:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837219.183921:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837219.183924:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788837219.183926:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837219.183927:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837219.183928:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837219.183929:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837219.183930:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837219.183931:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837219.183932:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837219.183933:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837219.183934:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837219.183935:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837219.183936:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837219.183937:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837219.183971:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788837219.183989:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000859c2679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708641536:0@lo:253: 00000100:00100000:0.0:1788837219.184061:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837219.184257:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f3ab4267 going to sleep for 11 seconds 00000100:00100000:2.0:1788837219.184439:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708641536 00000100:00100000:2.0:1788837219.184447:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708641536 00000100:00100000:2.0:1788837219.184578:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837219.184586:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db5603ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:5825:x1875731708641536:12345-0@lo:253: 20000000:01000000:2.0:1788837219.184631:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788837219.184634:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788837219.184945:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788837219.184994:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788837219.185449:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837219.186556:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788837219.186752:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788837219.186755:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788837219.186760:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788837219.186763:0:5839:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788837219.186779:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788837219.186975:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837219.187196:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788837219.187209:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788837219.187278:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788837219.187393:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788837219.187430:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788837219.187514:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788837219.187522:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788837219.187564:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788837219.187572:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788837219.187603:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788837219.187610:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788837219.187640:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788837219.187686:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788837219.187714:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788837219.187719:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788837219.187732:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837219.187937:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788837219.187947:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788837219.187975:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788837219.188001:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788837219.188049:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788837219.188059:0:5839:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788837219.188127:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788837219.188135:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788837219.188177:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788837219.188215:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788837219.188249:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788837219.188261:0:5839:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788837219.188402:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788837219.188411:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788837219.188442:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788837219.188472:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788837219.188635:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788837219.188685:0:5839:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788837219.188692:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788837219.189543:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788837219.189793:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788837219.189816:0:5839:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.143@tcp for mdt 20000000:01000000:0.0:1788837219.189818:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1788837219.189845:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788837219.189852:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788837219.189886:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788837219.189892:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1788837219.189927:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788837219.189935:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788837219.189959:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788837219.189986:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788837219.190036:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788837219.190039:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788837219.190043:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788837219.190051:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788837219.190054:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788837219.190078:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788837219.190080:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788837219.190629:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788837219.190850:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788837219.190888:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788837219.190915:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788837219.190925:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788837219.190927:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788837219.191391:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788837219.191585:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788837219.191622:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788837219.191671:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788837219.191684:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788837219.191686:0:5839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788837219.191690:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788837219.191692:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788837219.191696:0:5839:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788837219.191701:0:5839:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788837219.192025:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788837219.192121:0:5839:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788837219.197726:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788837219.197780:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788837219.197876:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788837219.197899:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788837219.197918:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.197932:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.197941:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.197947:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.197959:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.197966:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.197971:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001180266a already unused, calling callback (00000000edb9152a) 00010000:00010000:2.0:1788837219.197974:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.197980:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.197990:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.197996:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.198000:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001180266a/0x843cbef8be3050a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788837219.198016:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788837219.408021:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db5603ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:5825:x1875731708641536:12345-0@lo:253: Request processed in 223429us (223953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.408053:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837219.408128:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000859c2679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708641536:0@lo:253: 10000000:01000000:2.0:1788837219.408141:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788837219.408143:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837219.408145:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788837219.408146:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837219.408147:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788837219.408149:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837219.408154:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837219.408155:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837219.408157:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788837219.408158:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788837219.408160:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837219.408161:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788837219.408234:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007e646ccb from lustre-MDT0000 10000000:01000000:2.0:1788837219.408257:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788837219.408260:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788837219.408264:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9acb587319b8 10000000:01000000:2.0:1788837219.408276:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837219.408283:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9acb587319b8 from 1 10000000:01000000:2.0:1788837219.408286:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788837219.408371:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000001180266a/0x843cbef8be3050ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.408381:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000001180266a/0x843cbef8be3050ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.408390:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000001180266a/0x843cbef8be3050ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837219.408406:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708641664:0@lo:101: 00000100:00100000:2.0:1788837219.408449:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837219.408526:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1090fe7 going to sleep for 11 seconds 00000100:00100000:3.0:1788837219.408598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708641664 00000100:00100000:3.0:1788837219.408604:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708641664 00000100:00100000:3.0:1788837219.408719:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837219.408727:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e54958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:5825:x1875731708641664:12345-0@lo:101: 00010000:00010000:3.0:1788837219.408738:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837219.408749:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065409c68/0x843cbef8be3050b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3050ae expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837219.408769:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065409c68/0x843cbef8be3050b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3050ae expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837219.408790:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065409c68/0x843cbef8be3050b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3050ae expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837219.408797:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065409c68, rc 0) 00000100:00100000:3.0:1788837219.408831:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e54958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+6:5825:x1875731708641664:12345-0@lo:101: Request processed in 105us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837219.408837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837219.408891:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708641664:0@lo:101: 00010000:00010000:2.0:1788837219.408902:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000001180266a/0x843cbef8be3050ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.408909:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000001180266a/0x843cbef8be3050ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837219.408956:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708641792:0@lo:501: 00000100:00100000:2.0:1788837219.408976:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837219.409030:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1090fe7 going to sleep for 11 seconds 00000100:00100000:0.0:1788837219.409089:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708641792 00000100:00100000:0.0:1788837219.409093:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708641792 00000100:00100000:0.0:1788837219.409119:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837219.409124:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f86de71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+6:5825:x1875731708641792:12345-0@lo:501: 00000100:00100000:0.0:1788837219.409362:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f86de71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+6:5825:x1875731708641792:12345-0@lo:501: Request processed in 238us (385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837219.409368:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837219.409487:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708641792:0@lo:501: 10000000:01000000:2.0:1788837219.409509:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788837219.409527:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 000000001180266a/0x843cbef8be3050ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.409534:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 000000001180266a/0x843cbef8be3050ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837219.409540:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9acb6a76b800 10000000:01000000:2.0:1788837219.409544:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788837219.409547:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9acb6a76b800 10000000:01000000:2.0:1788837219.409549:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788837219.409552:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9acb6a76b800 from 1 10000000:01000000:2.0:1788837219.409554:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788837219.409567:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000a2e79660/0x843cbef8be3050bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.409573:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000a2e79660/0x843cbef8be3050bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.409578:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000a2e79660/0x843cbef8be3050bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837219.409587:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708641920:0@lo:101: 00000100:00100000:2.0:1788837219.409621:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837219.409638:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1090fe7 going to sleep for 11 seconds 00000100:00100000:0.0:1788837219.409744:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708641920 00000100:00100000:0.0:1788837219.409749:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708641920 00000100:00100000:0.0:1788837219.409768:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837219.409773:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7eb1a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+6:5825:x1875731708641920:12345-0@lo:101: 00010000:00010000:0.0:1788837219.409781:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837219.409790:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d661377/0x843cbef8be3050c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3050bc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.409804:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d661377/0x843cbef8be3050c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3050bc expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.409811:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d661377/0x843cbef8be3050c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3050bc expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.409817:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d661377, rc 0) 00000100:00100000:0.0:1788837219.409852:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7eb1a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+7:5825:x1875731708641920:12345-0@lo:101: Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.409858:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837219.409920:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708641920:0@lo:101: 00010000:00010000:2.0:1788837219.409929:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000a2e79660/0x843cbef8be3050bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.409935:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000a2e79660/0x843cbef8be3050bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837219.409945:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788837219.409957:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000a2e79660/0x843cbef8be3050bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.409962:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000a2e79660/0x843cbef8be3050bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837219.409967:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788837219.409970:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837219.409974:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9acb6a76b800 10000000:01000000:2.0:1788837219.409976:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788837219.409979:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788837219.409980:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837219.409991:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000009bbfc2dc/0x843cbef8be3050ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.409998:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000009bbfc2dc/0x843cbef8be3050ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.410004:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000009bbfc2dc/0x843cbef8be3050ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837219.410019:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642048:0@lo:101: 00000100:00100000:2.0:1788837219.410043:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837219.410054:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1090fe7 going to sleep for 11 seconds 00000100:00100000:0.0:1788837219.410111:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708642048 00000100:00100000:0.0:1788837219.410114:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708642048 00000100:00100000:0.0:1788837219.410137:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837219.410141:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ca630bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+7:5825:x1875731708642048:12345-0@lo:101: 00010000:00010000:0.0:1788837219.410148:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837219.410154:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004940103c/0x843cbef8be3050d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3050ca expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.410166:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004940103c/0x843cbef8be3050d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3050ca expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.410235:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004940103c/0x843cbef8be3050d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3050ca expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.410242:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004940103c, rc 0) 00000100:00100000:0.0:1788837219.410283:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ca630bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+8:5825:x1875731708642048:12345-0@lo:101: Request processed in 141us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.410288:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837219.410372:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642048:0@lo:101: 00010000:00010000:2.0:1788837219.410380:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000009bbfc2dc/0x843cbef8be3050ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.410388:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000009bbfc2dc/0x843cbef8be3050ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837219.410420:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642176:0@lo:501: 00000100:00100000:2.0:1788837219.410442:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837219.410467:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1090fe7 going to sleep for 11 seconds 00000100:00100000:0.0:1788837219.410515:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708642176 00000100:00100000:0.0:1788837219.410519:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708642176 00000100:00100000:0.0:1788837219.410535:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837219.410539:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009981228c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+8:5825:x1875731708642176:12345-0@lo:501: 00000100:00100000:0.0:1788837219.410802:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009981228c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:5825:x1875731708642176:12345-0@lo:501: Request processed in 261us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.410808:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837219.410939:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642176:0@lo:501: 00000100:00100000:2.0:1788837219.410964:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642304:0@lo:503: 00000100:00100000:2.0:1788837219.410998:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837219.411055:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1090fe7 going to sleep for 11 seconds 00000100:00100000:1.0:1788837219.411088:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708642304 00000100:00100000:1.0:1788837219.411093:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708642304 00000100:00100000:0.0:1788837219.411131:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837219.411137:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000263a363a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:5825:x1875731708642304:12345-0@lo:503: 00000100:00100000:0.0:1788837219.411364:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000263a363a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:5825:x1875731708642304:12345-0@lo:503: Request processed in 227us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.411370:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837219.411458:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642304:0@lo:503: 00000100:00100000:2.0:1788837219.411850:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:5868:1875731708642432:0@lo:502: 00000100:00100000:2.0:1788837219.411882:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837219.411908:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf35b8a9 going to sleep for 11 seconds 00000100:00100000:3.0:1788837219.411962:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708642432 00000100:00100000:3.0:1788837219.411966:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708642432 00000100:00100000:3.0:1788837219.411998:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837219.412004:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee614c7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:5868:x1875731708642432:12345-0@lo:502: 00000100:00100000:3.0:1788837219.412148:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee614c7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:5868:x1875731708642432:12345-0@lo:502: Request processed in 144us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837219.412155:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837219.412331:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:5868:1875731708642432:0@lo:502: 00000020:01000000:2.0:1788837219.412352:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837219.412362:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837219.412370:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788837219.412375:0:5868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788837219.412377:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837219.412388:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000073bdae90) 00000020:00000080:2.0:1788837219.412403:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788837219.412408:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788837219.412465:0:5868:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788837219.412471:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be3050df 00000020:00000080:2.0:1788837219.412738:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788837219.412743:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837219.412747:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837219.412748:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788837219.412751:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837219.412754:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837219.412755:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788837219.412758:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837219.412764:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b8780f8d) 00000020:00000080:2.0:1788837219.412774:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788837219.412777:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788837219.412779:0:5868:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788837219.412781:0:5868:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788837219.412787:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788837219.412835:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007e646ccb from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788837219.412855:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a9c36c87) 00000020:00000080:2.0:1788837219.412871:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788837219.412914:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788837219.412919:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be3050f4 00000020:00000080:2.0:1788837219.413038:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788837219.413045:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788837219.413049:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x843cbef8be3050fb 00080000:01000000:2.0:1788837219.413054:0:5868:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788837219.413056:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be305102 00080000:10000000:2.0:1788837219.413626:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788837219.413878:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788837219.418493:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788837219.524986:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788837219.525478:0:5868:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788837219.530395:0:5868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788837219.530941:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788837219.608717:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c8f29445) 00000020:00000080:0.0:1788837219.608739:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788837219.608812:0:5868:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788837219.608819:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be305110 00000020:00000080:2.0:1788837219.619458:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788837219.621026:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837219.659761:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788837219.687975:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837219.718237:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837219.751615:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788837219.775776:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788837219.800067:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x843cbef8be305117 00000020:00000080:3.0:1788837219.801524:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788837219.801548:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837219.801556:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837219.801558:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788837219.801561:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837219.801575:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837219.801577:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788837219.801580:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788837219.801582:0:5868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788837219.801585:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837219.801587:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837219.801588:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788837219.801590:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837219.801594:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837219.801595:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788837219.801599:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788837219.801641:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788837219.801704:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b632885 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:5868:1875731708642560:0@lo:502: 00000100:00100000:3.0:1788837219.801780:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837219.801883:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d989211c going to sleep for 11 seconds 00000100:00100000:2.0:1788837219.802047:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708642560 00000100:00100000:2.0:1788837219.802054:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708642560 00000100:00100000:2.0:1788837219.802137:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837219.802146:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0c2b3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:5868:x1875731708642560:12345-0@lo:502: 00000100:00100000:2.0:1788837219.802638:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0c2b3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:5868:x1875731708642560:12345-0@lo:502: Request processed in 492us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837219.802645:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837219.802766:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b632885 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:5868:1875731708642560:0@lo:502: 00000020:01000000:3.0:1788837219.802793:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837219.802797:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837219.802799:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788837219.802802:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788837219.802948:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788837219.802967:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788837219.802985:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 000000009bbfc2dc/0x843cbef8be3050ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.802996:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 000000009bbfc2dc/0x843cbef8be3050ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837219.803005:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9acb6a76b800 from 1 10000000:01000000:0.0:1788837219.803008:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837219.803035:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.803042:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.803050:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837219.803063:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642688:0@lo:101: 00000100:00100000:0.0:1788837219.803094:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837219.803485:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042606e68 going to sleep for 11 seconds 00000100:00100000:1.0:1788837219.803581:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708642688 00000100:00100000:1.0:1788837219.803586:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708642688 00000100:00100000:3.0:1788837219.803720:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837219.803729:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7cc9dd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:5825:x1875731708642688:12345-0@lo:101: 00010000:00010000:3.0:1788837219.803740:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837219.803753:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30511e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837219.803774:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30511e expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837219.803783:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30511e expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837219.803801:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000054e2cd2c, rc 0) 00000100:00100000:3.0:1788837219.803843:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7cc9dd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+10:5825:x1875731708642688:12345-0@lo:101: Request processed in 115us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837219.803849:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837219.803919:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642688:0@lo:101: 00010000:00010000:0.0:1788837219.803933:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.803950:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837219.804508:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642816:0@lo:256: 00000100:00100000:0.0:1788837219.804547:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837219.804565:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042606e68 going to sleep for 11 seconds 00000100:00100000:3.0:1788837219.804763:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708642816 00000100:00100000:3.0:1788837219.804769:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708642816 00000100:00100000:3.0:1788837219.804795:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837219.804802:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047c1dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+10:5825:x1875731708642816:12345-0@lo:256: 20000000:01000000:3.0:1788837219.804817:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788837219.804822:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788837219.804880:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047c1dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+10:5825:x1875731708642816:12345-0@lo:256: Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837219.804887:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837219.804955:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642816:0@lo:256: 10000000:01000000:0.0:1788837219.805619:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837219.805634:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.805644:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837219.805653:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb6a76b800 from 1 10000000:01000000:0.0:1788837219.805656:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837219.805679:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.805685:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.805693:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837219.805706:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642944:0@lo:101: 00000100:00100000:0.0:1788837219.805735:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837219.805768:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042606e68 going to sleep for 11 seconds 00000100:00100000:3.0:1788837219.805855:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708642944 00000100:00100000:3.0:1788837219.805860:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708642944 00000100:00100000:3.0:1788837219.805879:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788837219.805885:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a93b9a4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+10:5825:x1875731708642944:12345-0@lo:101: 00010000:00010000:3.0:1788837219.805893:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837219.805904:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30512c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837219.805922:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30512c expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837219.805929:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30512c expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837219.805945:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051573034, rc 0) 00000100:00100000:3.0:1788837219.805972:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a93b9a4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:5825:x1875731708642944:12345-0@lo:101: Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837219.805977:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837219.806047:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708642944:0@lo:101: 00010000:00010000:0.0:1788837219.806058:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.806065:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837219.806106:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643072:0@lo:501: 00000100:00100000:0.0:1788837219.806127:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837219.806292:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042606e68 going to sleep for 11 seconds 00000100:00100000:2.0:1788837219.806514:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708643072 00000100:00100000:2.0:1788837219.806519:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708643072 00000100:00100000:2.0:1788837219.806788:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788837219.806795:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d82e0f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:5825:x1875731708643072:12345-0@lo:501: 00000100:00100000:2.0:1788837219.807496:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d82e0f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:5825:x1875731708643072:12345-0@lo:501: Request processed in 701us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837219.807505:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837219.807582:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643072:0@lo:501: 00000100:00100000:0.0:1788837219.807617:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643200:0@lo:503: 00000100:00100000:0.0:1788837219.807655:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837219.807851:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042606e68 going to sleep for 11 seconds 00000100:00100000:1.0:1788837219.807943:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708643200 00000100:00100000:1.0:1788837219.807948:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708643200 00000100:00100000:1.0:1788837219.807972:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837219.807978:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018fa2de0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:5825:x1875731708643200:12345-0@lo:503: 00000040:00080000:1.0:1788837219.808014:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837219.808063:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018fa2de0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:5825:x1875731708643200:12345-0@lo:503: Request processed in 84us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837219.808069:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837219.808162:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643200:0@lo:503: 00000040:00080000:0.0:1788837219.809397:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788837219.809674:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788837219.809692:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837219.809733:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.809754:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837219.809790:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788837219.809792:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9acb6a76b800 10000000:01000000:1.0:1788837219.809795:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9acb6a76b800 10000000:01000000:1.0:1788837219.809799:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837219.809805:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb6a76b800 from 1 10000000:01000000:1.0:1788837219.809807:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837219.809849:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000009ac10f58/0x843cbef8be30513a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.809856:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000009ac10f58/0x843cbef8be30513a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.809863:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000009ac10f58/0x843cbef8be30513a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837219.809879:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063b4f23f pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643328:0@lo:101: 00000100:00100000:1.0:1788837219.809923:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837219.809958:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b1b6d5a going to sleep for 11 seconds 00000100:00100000:0.0:1788837219.810008:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708643328 00000100:00100000:0.0:1788837219.810013:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708643328 00000100:00100000:0.0:1788837219.810048:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837219.810055:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d74b0f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:5825:x1875731708643328:12345-0@lo:101: 00010000:00010000:0.0:1788837219.810065:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837219.810075:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090572399/0x843cbef8be305141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30513a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.810092:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090572399/0x843cbef8be305141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30513a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.810110:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090572399/0x843cbef8be305141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30513a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.810117:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090572399, rc 0) 00000100:00100000:0.0:1788837219.810164:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d74b0f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5825:x1875731708643328:12345-0@lo:101: Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.810170:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837219.810434:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063b4f23f pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643328:0@lo:101: 00010000:00010000:1.0:1788837219.810450:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000009ac10f58/0x843cbef8be30513a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.810457:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000009ac10f58/0x843cbef8be30513a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837219.810508:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063b4f23f pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643456:0@lo:501: 00000100:00100000:1.0:1788837219.810534:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837219.810562:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b1b6d5a going to sleep for 11 seconds 00000100:00100000:0.0:1788837219.810609:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708643456 00000100:00100000:0.0:1788837219.810613:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708643456 00000100:00100000:0.0:1788837219.810639:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837219.810644:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026179de8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5825:x1875731708643456:12345-0@lo:501: 00000100:00100000:0.0:1788837219.810861:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026179de8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5825:x1875731708643456:12345-0@lo:501: Request processed in 216us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.810868:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837219.810957:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063b4f23f pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643456:0@lo:501: 00000100:00100000:1.0:1788837219.810980:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063b4f23f pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643584:0@lo:503: 00000100:00100000:1.0:1788837219.811012:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837219.811030:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b1b6d5a going to sleep for 11 seconds 00000100:00100000:0.0:1788837219.811074:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708643584 00000100:00100000:0.0:1788837219.811078:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708643584 00000100:00100000:0.0:1788837219.811142:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837219.811149:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000041da4df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5825:x1875731708643584:12345-0@lo:503: 00000100:00100000:0.0:1788837219.811491:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000041da4df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5825:x1875731708643584:12345-0@lo:503: Request processed in 343us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.811498:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837219.811578:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063b4f23f pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708643584:0@lo:503: 00000100:00100000:3.0:1788837219.812278:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b632885 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:5873:1875731708643712:0@lo:502: 00000100:00100000:3.0:1788837219.812454:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837219.812508:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d5c9be10 going to sleep for 11 seconds 00000100:00100000:2.0:1788837219.812538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708643712 00000100:00100000:2.0:1788837219.812543:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708643712 00000100:00100000:2.0:1788837219.812612:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837219.812619:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed8fdbea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5873:x1875731708643712:12345-0@lo:502: 00000100:00100000:2.0:1788837219.812840:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed8fdbea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5873:x1875731708643712:12345-0@lo:502: Request processed in 221us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837219.812847:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788837219.812913:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b632885 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:5873:1875731708643712:0@lo:502: 00000020:01000004:3.0:1788837219.812968:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788837219.812980:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000bbbc9784) 00000020:00000080:3.0:1788837219.812995:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788837219.813063:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007e646ccb from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788837219.813066:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007e646ccb from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788837219.813069:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007e646ccb 4 00010000:00080000:3.0:1788837219.813100:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cd7a80ba@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1788837219.814658:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788837219.814847:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788837219.814879:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788837219.814891:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x843cbef8be30514f 00000100:00080000:3.0:1788837219.814899:0:5873:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837219.814904:0:5873:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cd7a80ba using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1788837219.814935:0:5873:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006b632885 x1875731708643840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837219.814972:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b632885 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708643840:0@lo:38: 00000100:00100000:3.0:1788837219.815026:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788837219.815076:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788837219.815251:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708643840 00000100:00100000:0.0:1788837219.815258:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708643840 00000100:00100000:0.0:1788837219.815321:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837219.815327:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5ec3823 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1875731708643840:12345-0@lo:38: 00000100:00100000:0.0:1788837219.815375:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5ec3823 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1875731708643840:12345-0@lo:38: Request processed in 47us (349us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788837219.815388:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837219.815441:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837219.815447:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000cd7a80ba lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837219.815451:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788837219.815454:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b632885 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708643840:0@lo:38: 00000100:00100000:3.0:1788837219.817757:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000418720ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:5873:1875731708643968:0@lo:502: 00000100:00100000:3.0:1788837219.817826:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837219.820019:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fd93b25 going to sleep for 11 seconds 00000100:00100000:2.0:1788837219.820116:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708643968 00000100:00100000:2.0:1788837219.820130:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708643968 00000100:00100000:1.0:1788837219.820228:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837219.820238:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a27dec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5873:x1875731708643968:12345-0@lo:502: 00000100:00100000:1.0:1788837219.823258:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a27dec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5873:x1875731708643968:12345-0@lo:502: Request processed in 3018us (5428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837219.823284:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788837219.823341:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000418720ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:5873:1875731708643968:0@lo:502: 00000040:00080000:3.0:1788837219.823382:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788837219.823600:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788837219.823619:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837219.823638:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 000000009ac10f58/0x843cbef8be30513a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837219.823650:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 000000009ac10f58/0x843cbef8be30513a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788837219.823701:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788837219.823703:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788837219.823705:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837219.823706:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837219.823707:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837219.823708:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837219.823709:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837219.823711:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788837219.823712:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837219.823713:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837219.823715:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837219.823716:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788837219.823719:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788837219.823722:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788837219.823723:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788837219.823724:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837219.823725:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837219.823727:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837219.823728:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837219.823729:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837219.823730:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788837219.823731:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837219.823732:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837219.823733:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837219.823734:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788837219.823754:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788837219.823767:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708644096:0@lo:253: 00000100:00100000:2.0:1788837219.823813:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837219.823862:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b00e2131 going to sleep for 11 seconds 00000100:00100000:1.0:1788837219.823862:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708644096 00000100:00100000:1.0:1788837219.823869:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708644096 00000100:00100000:1.0:1788837219.823918:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837219.823926:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000219c48a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5825:x1875731708644096:12345-0@lo:253: 20000000:01000000:1.0:1788837219.823949:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788837219.823961:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788837219.853802:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788837219.853821:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788837219.853877:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788837219.853882:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788837219.853902:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.853919:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30511e expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.853944:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.853980:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30511e expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.853993:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30511e expref: 12 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837219.854006:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016bfff8b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875731708644224:0@lo:104: 00000100:00100000:1.0:1788837219.854069:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837219.854130:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086472561 going to sleep for 11 seconds 00000100:00100000:0.0:1788837219.854295:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708644224 00000100:00100000:0.0:1788837219.854324:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708644224 00000100:00100000:0.0:1788837219.854366:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837219.854373:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091d3b61b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5860:x1875731708644224:12345-0@lo:104: 00010000:00010000:0.0:1788837219.854385:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.854434:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837219.854439:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091d3b61b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5860:x1875731708644224:12345-0@lo:104: Request processed in 66us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.854445:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788837219.854465:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837219.854469:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.854476:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000052fea100 already unused, calling callback (00000000027c5515) 10000000:00010000:0.0:1788837219.854479:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.854486:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837219.854503:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837219.854509:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837219.854533:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837219.854809:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016bfff8b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875731708644224:0@lo:104: 00010000:00010000:1.0:1788837219.854830:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855099:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837219.855122:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855130:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 0000000052fea100/0x843cbef8be30511e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305125 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855146:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837219.855148:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837219.855149:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837219.855258:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837219.855279:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708644352:0@lo:103: 00000100:00100000:0.0:1788837219.855352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837219.855397:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708644352 00000100:00100000:0.0:1788837219.855401:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708644352 00010000:00010000:0.0:1788837219.855419:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30511e expref: 13 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837219.855443:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837219.855450:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007639d4fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:3313:x1875731708644352:12345-0@lo:103: 00010000:00010000:0.0:1788837219.855461:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837219.855464:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30511e expref: 13 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855483:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30511e expref: 13 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855497:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000054e2cd2c/0x843cbef8be305125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30511e expref: 13 pid: 5838 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855510:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855517:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788837219.855531:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001649502s 00010000:00010000:0.0:1788837219.855612:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855620:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855626:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855631:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855636:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c5f94d4 already unused, calling callback (00000000edb9152a) 00010000:00010000:0.0:1788837219.855639:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855645:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855665:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837219.855674:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837219.855703:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007639d4fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:3313:x1875731708644352:12345-0@lo:103: Request processed in 255us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837219.855710:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788837219.855892:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.855900:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837219.855905:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c5f94d4/0x843cbef8be305156 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837219.856584:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708644352:0@lo:103: 00000100:00100000:2.0:1788837219.873343:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000219c48a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:5825:x1875731708644096:12345-0@lo:253: Request processed in 49410us (49523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837219.873357:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837219.873357:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099d48217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:5825:1875731708644096:0@lo:253: 10000000:01000000:1.0:1788837219.873371:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788837219.873374:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788837219.873388:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788837219.873389:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837219.873390:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837219.873391:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837219.873393:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837219.873394:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837219.873396:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788837219.873397:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837219.873398:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837219.873400:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837219.873401:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788837219.873414:0:5825:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788837219.888852:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837219.889537:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788837219.889754:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837219.889918:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788837219.890565:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837219.890737:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788837219.891622:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837219.891777:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788837219.891943:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837219.892084:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788837219.892459:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837219.892621:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788837219.937829:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788837219.964080:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788837219.964453:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1788837219.966341:0:5878:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788837219.966348:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788837219.967507:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788837219.967686:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788837219.968118:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788837219.968125:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788837219.968253:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837219.972847:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788837219.973440:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788837219.973470:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788837219.973725:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788837219.973927:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788837219.975165:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788837219.979513:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788837219.979711:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788837219.979860:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788837219.979988:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788837219.980108:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788837219.985575:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788837219.985743:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788837219.985868:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788837219.986040:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788837219.986565:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788837219.986698:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788837219.986860:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788837219.986983:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788837219.987124:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788837219.987346:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788837219.987811:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788837219.988005:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788837219.990463:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788837219.990716:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788837219.990856:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788837219.990976:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788837219.991107:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788837219.991486:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788837219.991687:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788837219.991823:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788837219.991955:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788837219.992074:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788837219.992472:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788837219.992704:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788837219.992973:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788837219.993107:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788837219.993631:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788837220.000526:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788837220.061411:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788837220.061447:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6b081caf988 00100000:10000000:1.0:1788837220.061474:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788837220.064802:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788837220.064817:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788837220.064830:0:5825:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788837220.064846:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788837220.076055:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837220.157773:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788837220.157851:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1788837220.157855:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788837221.095773:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837222.117416:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837223.141385:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788837223.855221:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788837224.165467:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788837224.310531:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788837224.310538:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9acb6a76b800 from 3 10000000:01000000:0.0:1788837224.310543:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837224.310600:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000009feb5d13/0x843cbef8be30515d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837224.310628:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000009feb5d13/0x843cbef8be30515d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837224.310640:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000009feb5d13/0x843cbef8be30515d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837224.310679:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708644480:0@lo:101: 00000100:00100000:0.0:1788837224.310784:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837224.310845:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f35c3ec going to sleep for 11 seconds 00000100:00100000:3.0:1788837224.312059:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708644480 00000100:00100000:3.0:1788837224.312077:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708644480 00000100:00100000:3.0:1788837224.312149:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837224.312159:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005a963f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:5841:x1875731708644480:12345-0@lo:101: 00010000:00010000:3.0:1788837224.312181:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837224.312202:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035e3bccc/0x843cbef8be305164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30515d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837224.312248:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035e3bccc/0x843cbef8be305164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30515d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837224.312260:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035e3bccc/0x843cbef8be305164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30515d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837224.312269:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035e3bccc, rc 0) 00000100:00100000:3.0:1788837224.312367:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005a963f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708644480:12345-0@lo:101: Request processed in 209us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837224.312391:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837224.312462:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000921dbdeb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708644480:0@lo:101: 00010000:00010000:3.0:1788837224.312483:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000009feb5d13/0x843cbef8be30515d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837224.312492:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000009feb5d13/0x843cbef8be30515d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837224.312557:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000418720ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708644608:0@lo:256: 00000100:00100000:3.0:1788837224.312598:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837224.312628:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e0d3061 going to sleep for 11 seconds 00000100:00100000:0.0:1788837224.314624:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708644608 00000100:00100000:0.0:1788837224.314644:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708644608 00000100:00100000:0.0:1788837224.314898:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837224.314912:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1f2754c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708644608:12345-0@lo:256: 20000000:01000000:0.0:1788837224.314943:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788837224.314966:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788837224.314970:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788837224.315123:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1f2754c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708644608:12345-0@lo:256: Request processed in 214us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837224.315131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837224.315228:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000418720ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708644608:0@lo:256: 10000000:01000000:0.0:1788837224.315916:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837224.315927:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 000000009feb5d13/0x843cbef8be30515d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837224.315938:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 000000009feb5d13/0x843cbef8be30515d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837225.190437:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837225.326280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788837225.326291:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788837225.326294:0:8:0:(import.c:65:import_set_state_nolock()) 00000000cd7a80ba lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837225.326769:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cd7a80ba using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1788837225.326794:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e944ab83 x1875731708644864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837225.326828:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e944ab83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708644864:0@lo:38: 00000100:00100000:0.0:1788837225.326889:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837225.328675:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b68302 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708644736:0@lo:400: 00000100:00100000:0.0:1788837225.328736:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837225.328794:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708644736 00000100:00100000:0.0:1788837225.328802:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708644736 00000100:00100000:0.0:1788837225.328842:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837225.328851:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d8c7f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:3315:x1875731708644736:12345-0@lo:400: 00000100:00100000:0.0:1788837225.328898:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d8c7f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:3315:x1875731708644736:12345-0@lo:400: Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837225.328905:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837225.328951:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b68302 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708644736:0@lo:400: 00000100:00100000:0.0:1788837225.337725:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708644864 00000100:00100000:0.0:1788837225.337739:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708644864 00000100:00100000:0.0:1788837225.337781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837225.337788:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000055d8a63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875731708644864:12345-0@lo:38: 00010000:00080000:0.0:1788837225.337823:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788837225.337863:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x843cbef8be30516b 00000004:00100000:0.0:1788837225.337913:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788837225.338034:0:5846:0:(import.c:65:import_set_state_nolock()) 00000000c3270589 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837225.338134:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000055d8a63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875731708644864:12345-0@lo:38: Request processed in 345us (11245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837225.338141:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788837225.338190:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e944ab83 x1875731708644864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788837225.338208:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788837225.338216:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788837225.338221:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788837225.338223:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000cd7a80ba lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788837225.338241:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e944ab83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708644864:0@lo:38: 00010000:00010000:2.0:1788837226.213463:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837227.237581:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837228.262760:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788837228.312990:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeafceffb0 20000000:00000080:2.0:1788837228.313007:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9acb741ed400 uarg=0000000000000000 20000000:01000000:2.0:1788837228.313039:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788837228.313045:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788837228.313049:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788837228.313235:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788837228.313247:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788837228.317225:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837228.317557:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788837228.317599:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788837228.317626:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788837228.317639:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788837228.317653:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.317668:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30512c expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.317674:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.317718:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30512c expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.317733:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30512c expref: 11 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837228.317747:0:6324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002914b789 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875731708644992:0@lo:104: 00000100:00100000:2.0:1788837228.317813:0:6324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837228.317876:0:6324:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e7d0bb2 going to sleep for 11 seconds 00000100:00100000:1.0:1788837228.318099:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708644992 00000100:00100000:1.0:1788837228.318107:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708644992 00000100:00100000:1.0:1788837228.318162:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837228.318171:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000720c2dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:6324:x1875731708644992:12345-0@lo:104: 00010000:00010000:1.0:1788837228.318181:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837228.318287:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837228.318292:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000720c2dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:6324:x1875731708644992:12345-0@lo:104: Request processed in 124us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837228.318299:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837228.318523:0:6324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002914b789 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875731708644992:0@lo:104: 00010000:00010000:3.0:1788837228.318543:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.319361:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837228.319369:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.319378:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ca858310 already unused, calling callback (00000000027c5515) 10000000:00010000:2.0:1788837228.319381:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.319389:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837228.319396:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837228.319402:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788837228.319441:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.319448:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837228.319468:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.319484:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 00000000ca858310/0x843cbef8be30512c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305133 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.319502:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837228.319503:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837228.319505:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837228.319739:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053893d11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708645120:0@lo:103: 00000100:00100000:1.0:1788837228.319787:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837228.321696:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708645120 00000100:00100000:2.0:1788837228.321707:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708645120 00010000:00010000:2.0:1788837228.321737:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30512c expref: 12 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837228.321810:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837228.321819:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016bfff8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:3316:x1875731708645120:12345-0@lo:103: 00010000:00010000:2.0:1788837228.321832:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837228.321836:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30512c expref: 12 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321847:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30512c expref: 12 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321863:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000051573034/0x843cbef8be305133 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30512c expref: 12 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321878:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321886:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321914:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321920:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321937:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321943:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321950:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000392f2823 already unused, calling callback (00000000edb9152a) 00010000:00010000:2.0:1788837228.321953:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321961:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321978:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837228.321989:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837228.322054:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016bfff8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:3316:x1875731708645120:12345-0@lo:103: Request processed in 236us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837228.322062:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837228.322127:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053893d11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708645120:0@lo:103: 00010000:00010000:3.0:1788837228.322182:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837228.322190:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837228.322196:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000392f2823/0x843cbef8be305172 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837229.288066:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837230.309435:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837230.437919:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e944ab83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708645248:0@lo:400: 00000100:00100000:0.0:1788837230.437988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837230.438044:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837230.438050:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8b68302 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708645376:0@lo:400: 00000100:00100000:0.0:1788837230.438075:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837230.442816:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708645248 00000100:00100000:3.0:1788837230.442831:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708645248 00000100:00100000:3.0:1788837230.442893:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837230.442902:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c021c49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:3313:x1875731708645248:12345-0@lo:400: 00000100:00100000:3.0:1788837230.443000:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c021c49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:3313:x1875731708645248:12345-0@lo:400: Request processed in 100us (5012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837230.443008:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837230.443049:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708645376 00000100:00100000:3.0:1788837230.443054:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708645376 00000100:00100000:3.0:1788837230.443080:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837230.443087:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030009694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708645376:12345-0@lo:400: 00000100:00100000:3.0:1788837230.443235:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030009694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708645376:12345-0@lo:400: Request processed in 150us (5160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837230.443243:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788837230.443284:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e8b68302 x1875731708645376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837230.443299:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8b68302 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708645376:0@lo:400: 00000100:00100000:3.0:1788837230.443348:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e944ab83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708645248:0@lo:400: 00010000:00010000:2.0:1788837231.335390:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837232.357412:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837233.387747:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788837233.510367:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837233.510375:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb6a76b800 from 1 10000000:01000000:3.0:1788837233.510379:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837233.510421:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000060bad697/0x843cbef8be305179 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837233.510433:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000060bad697/0x843cbef8be305179 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837233.510442:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000060bad697/0x843cbef8be305179 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837233.510463:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001cfb1268 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708645504:0@lo:101: 00000100:00100000:3.0:1788837233.510537:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837233.510590:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000002816ac43 going to sleep for 11 seconds 00000100:00100000:0.0:1788837233.510657:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708645504 00000100:00100000:0.0:1788837233.510665:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708645504 00000100:00100000:0.0:1788837233.510718:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837233.510725:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a438b9f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:5841:x1875731708645504:12345-0@lo:101: 00010000:00010000:0.0:1788837233.510737:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837233.510749:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071a8012a/0x843cbef8be305180 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305179 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837233.510782:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071a8012a/0x843cbef8be305180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305179 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837233.510791:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071a8012a/0x843cbef8be305180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305179 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837233.510798:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071a8012a, rc 0) 00000100:00100000:0.0:1788837233.510844:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a438b9f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708645504:12345-0@lo:101: Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837233.510850:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837233.510972:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001cfb1268 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708645504:0@lo:101: 00010000:00010000:1.0:1788837233.510987:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000060bad697/0x843cbef8be305179 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837233.510994:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000060bad697/0x843cbef8be305179 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837233.511045:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061d0feca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708645632:0@lo:501: 00000100:00100000:1.0:1788837233.511155:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837233.511187:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a8dd114 going to sleep for 11 seconds 00000100:00100000:0.0:1788837233.511238:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708645632 00000100:00100000:0.0:1788837233.511243:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708645632 00000100:00100000:0.0:1788837233.511270:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837233.511276:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000639caebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708645632:12345-0@lo:501: 00000100:00100000:0.0:1788837233.512157:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000639caebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708645632:12345-0@lo:501: Request processed in 878us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837233.512166:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837233.513879:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061d0feca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708645632:0@lo:501: 00000100:00100000:3.0:1788837233.513933:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b8b8959 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708645760:0@lo:503: 00000100:00100000:3.0:1788837233.513998:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837233.514041:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e95ccbc going to sleep for 11 seconds 00000100:00100000:1.0:1788837233.514099:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708645760 00000100:00100000:1.0:1788837233.514106:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708645760 00000100:00100000:1.0:1788837233.514151:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837233.514159:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dff3b0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708645760:12345-0@lo:503: 00000100:00100000:1.0:1788837233.514545:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dff3b0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708645760:12345-0@lo:503: Request processed in 386us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837233.514553:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788837233.514833:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b8b8959 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708645760:0@lo:503: 00000100:00100000:0.0:1788837233.526232:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3607f84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:6672:1875731708645888:0@lo:502: 00000100:00100000:0.0:1788837233.526345:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837233.526391:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set 00000000afcf0720 going to sleep for 11 seconds 00000100:00100000:0.0:1788837233.526426:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708645888 00000100:00100000:0.0:1788837233.526433:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708645888 00000100:00100000:0.0:1788837233.526470:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788837233.526477:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000192d86ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6672:x1875731708645888:12345-0@lo:502: 00000100:00100000:0.0:1788837233.526712:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000192d86ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6672:x1875731708645888:12345-0@lo:502: Request processed in 235us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837233.526729:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788837233.526780:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3607f84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:6672:1875731708645888:0@lo:502: 00000020:01000000:0.0:1788837233.526807:0:6672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837233.526816:0:6672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837233.526818:0:6672:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788837233.526826:0:6672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb6a76b800 00000020:00000080:0.0:1788837233.526829:0:6672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788837233.526865:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:6672:1875731708646016:0@lo:502: 00000100:00100000:0.0:1788837233.526899:0:6672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837233.526915:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb62f36900 going to sleep for 11 seconds 00000100:00100000:0.0:1788837233.526937:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708646016 00000100:00100000:0.0:1788837233.526941:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708646016 00000100:00100000:0.0:1788837233.526962:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788837233.526968:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6672:x1875731708646016:12345-0@lo:502: 00000100:00100000:0.0:1788837233.527075:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6672:x1875731708646016:12345-0@lo:502: Request processed in 106us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837233.527081:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788837233.527117:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:6672:1875731708646016:0@lo:502: 00000020:01000000:0.0:1788837233.527134:0:6672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837233.527138:0:6672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837233.527139:0:6672:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788837233.527142:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788837233.527212:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788837233.527232:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837233.527242:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837233.527264:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788837234.276071:0:6696:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788837234.276083:0:6696:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788837234.276279:0:6696:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9acb45cdf000 00000020:01000004:0.0:1788837234.276293:0:6696:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788837234.276337:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788837234.276351:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9acb7ade0000) 00000020:00000080:0.0:1788837234.276368:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788837234.292882:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788837234.293337:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788837234.316860:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788837234.322963:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788837234.322995:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788837234.323065:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788837234.323274:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788837234.323762:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788837234.323772:0:6696:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788837234.323782:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x843cbef8be30518e 00000020:01000004:2.0:1788837234.323791:0:6696:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788837234.323812:0:6696:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788837234.323816:0:6696:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788837234.323822:0:6696:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788837234.323826:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788837234.323838:0:6696:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9acb7982b370) 00000020:00000080:2.0:1788837234.323848:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788837234.325073:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837234.325279:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788837234.325285:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788837234.329957:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788837234.329972:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788837234.330533:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788837234.330540:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788837234.331903:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837234.332108:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788837234.332114:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788837234.335050:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788837234.335063:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788837234.359624:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837234.359931:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788837234.359938:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788837234.362718:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788837234.362734:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788837234.363573:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788837234.363581:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788837234.367795:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837234.367999:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788837234.368005:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788837234.369257:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788837234.369269:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1788837234.406592:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837234.434294:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837234.434535:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788837234.434541:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788837234.437567:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788837234.437583:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788837234.438423:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788837234.438448:0:6696:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788837234.438454:0:6696:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788837234.465208:0:6696:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788837234.465245:0:6696:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788837234.465249:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788837234.465251:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788837234.465252:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837234.465253:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837234.465255:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837234.465256:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837234.465257:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837234.465259:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837234.465260:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837234.465261:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837234.465266:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837234.465270:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788837234.465272:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788837234.465273:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788837234.465274:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837234.465275:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837234.465275:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837234.465276:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837234.465277:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837234.465278:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837234.465279:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837234.465280:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837234.465281:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837234.465347:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788837234.465365:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708646144:0@lo:253: 00000100:00100000:1.0:1788837234.465845:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.465895:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837234.465905:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708646144 00000100:00100000:0.0:1788837234.465912:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708646144 00000100:00100000:0.0:1788837234.465967:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788837234.465977:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708646144:12345-0@lo:253: 20000000:01000000:0.0:1788837234.466013:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788837234.466016:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788837234.466021:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788837234.466024:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788837234.467687:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837234.467939:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788837234.467953:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788837234.467995:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788837234.468003:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788837234.468036:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788837234.468207:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788837234.468560:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788837234.468580:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:0.0:1788837234.468582:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1788837234.468617:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788837234.468625:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788837234.468681:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788837234.468689:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1788837234.468721:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788837234.468731:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788837234.468764:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788837234.468816:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788837234.472074:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788837234.472119:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:0.0:1788837234.472122:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1788837234.472184:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788837234.472193:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788837234.472252:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788837234.472261:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1788837234.472340:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788837234.472350:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788837234.472385:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788837234.472421:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788837234.472441:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788837234.472444:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788837234.472450:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788837234.472451:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788837234.472453:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788837234.472464:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788837234.472466:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788837234.472499:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788837234.472502:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788837234.473774:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788837234.473850:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788837234.473905:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788837234.476894:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788837234.476948:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788837234.476982:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788837234.477010:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788837234.477012:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788837234.477764:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788837234.478185:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788837234.478227:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788837234.478371:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788837234.478387:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788837234.478389:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788837234.479118:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788837234.479184:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788837234.479241:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788837234.481648:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788837234.481771:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788837234.481908:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1788837234.481926:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788837234.481945:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.481962:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb413f2e00/0x843cbef8be3050b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3050ae expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.481970:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb40030a00/0x843cbef8be3050d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3050ca expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.481977:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb40030600/0x843cbef8be305141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30513a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.481984:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.482021:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb40030600/0x843cbef8be305141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30513a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.482035:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb40030600/0x843cbef8be305141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30513a expref: 12 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.483194:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875731708646272:0@lo:104: 00000100:00100000:0.0:1788837234.483285:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.483394:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708646272 00000100:00100000:1.0:1788837234.483402:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708646272 00010000:00010000:0.0:1788837234.483608:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb40030a00/0x843cbef8be3050d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3050ca expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.483620:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb40030a00/0x843cbef8be3050d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3050ca expref: 12 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.483629:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875731708646400:0@lo:104: 00000100:00100000:0.0:1788837234.483680:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837234.483938:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb413f2e00/0x843cbef8be3050b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3050ae expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.483946:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb413f2e00/0x843cbef8be3050b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3050ae expref: 12 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.483955:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875731708646528:0@lo:104: 00000100:00100000:0.0:1788837234.483976:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.483998:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708646400 00000100:00100000:1.0:1788837234.484002:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708646400 00000100:00100000:1.0:1788837234.484023:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837234.484030:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:5838:x1875731708646272:12345-0@lo:104: 00010000:00010000:1.0:1788837234.484052:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb41485e00/0x843cbef8be30513a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.484108:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837234.484114:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:5838:x1875731708646272:12345-0@lo:104: Request processed in 84us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837234.484120:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837234.484136:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837234.484142:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5838:x1875731708646400:12345-0@lo:104: 00010000:00010000:1.0:1788837234.484150:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3050ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.484200:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788837234.484205:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5838:x1875731708646400:12345-0@lo:104: Request processed in 64us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837234.484211:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788837234.484325:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837234.484332:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb41485e00/0x843cbef8be30513a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484339:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb41485e00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837234.484342:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485e00/0x843cbef8be30513a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484350:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb41485e00/0x843cbef8be30513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837234.484362:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485e00/0x843cbef8be30513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837234.484367:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837234.484406:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb41485e00/0x843cbef8be30513a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484413:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837234.484446:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb41485e00/0x843cbef8be30513a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484453:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb41485e00/0x843cbef8be30513a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305141 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484466:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837234.484470:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3050ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484475:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a800 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837234.484477:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3050ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484483:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3050ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837234.484488:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3050ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837234.484492:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837234.484513:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3050ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484519:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837234.484524:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3050ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484529:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3050ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3050d1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.484538:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837234.484539:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837234.484541:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837234.484552:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708646784:0@lo:103: 00000100:00100000:3.0:1788837234.484581:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837234.484608:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837234.484614:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708646656:0@lo:103: 00000100:00100000:3.0:1788837234.484633:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.485185:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708646784 00000100:00100000:1.0:1788837234.485191:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708646784 00010000:00010000:1.0:1788837234.485211:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb40030a00/0x843cbef8be3050d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3050ca expref: 13 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837234.485239:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708646656 00000100:00100000:1.0:1788837234.485243:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708646656 00010000:00010000:1.0:1788837234.485253:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb40030600/0x843cbef8be305141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30513a expref: 14 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837234.485266:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837234.485273:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:3316:x1875731708646784:12345-0@lo:103: 00010000:00010000:1.0:1788837234.485296:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837234.485325:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb40030a00/0x843cbef8be3050d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3050ca expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.485335:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb40030a00/0x843cbef8be3050d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3050ca expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.485352:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837234.485387:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:3316:x1875731708646784:12345-0@lo:103: Request processed in 114us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837234.485393:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837234.485408:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837234.485414:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:3316:x1875731708646656:12345-0@lo:103: 00010000:00010000:1.0:1788837234.485439:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837234.485444:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb40030600/0x843cbef8be305141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30513a expref: 13 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.485453:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb40030600/0x843cbef8be305141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30513a expref: 13 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.485462:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837234.485485:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:3316:x1875731708646656:12345-0@lo:103: Request processed in 72us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837234.485491:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837234.485770:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708646656:0@lo:103: 00000100:00100000:3.0:1788837234.485779:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708646784:0@lo:103: 00010000:00010000:2.0:1788837234.485919:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837234.486023:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb48857000 going to sleep for 11 seconds 00010000:00010000:0.0:1788837234.486038:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40030600/0x843cbef8be305141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30513a expref: 12 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.486062:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875731708646272:0@lo:104: 00010000:00010000:0.0:1788837234.486072:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40030a00/0x843cbef8be3050d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3050ca expref: 11 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.486080:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875731708646400:0@lo:104: 00000100:00100000:1.0:1788837234.486240:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708646528 00000100:00100000:1.0:1788837234.486244:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708646528 00000100:00100000:1.0:1788837234.486592:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837234.486601:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5838:x1875731708646528:12345-0@lo:104: 00010000:00010000:1.0:1788837234.486613:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb4167b800/0x843cbef8be3050ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.486781:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837234.486787:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5838:x1875731708646528:12345-0@lo:104: Request processed in 188us (2811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837234.486802:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788837234.486843:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837234.486849:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167b800/0x843cbef8be3050ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.486856:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167b800 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837234.486859:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167b800/0x843cbef8be3050ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.486868:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167b800/0x843cbef8be3050ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837234.486885:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167b800/0x843cbef8be3050ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837234.486891:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837234.486924:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167b800/0x843cbef8be3050ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.486930:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837234.486950:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167b800/0x843cbef8be3050ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.486956:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167b800/0x843cbef8be3050ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3050b5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.486972:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837234.486974:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837234.486976:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837234.486989:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708646912:0@lo:103: 00000100:00100000:3.0:1788837234.487023:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837234.487079:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708646912 00000100:00100000:3.0:1788837234.487083:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708646912 00010000:00010000:3.0:1788837234.487101:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb413f2e00/0x843cbef8be3050b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3050ae expref: 11 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837234.487120:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837234.487127:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:3313:x1875731708646912:12345-0@lo:103: 00010000:00010000:3.0:1788837234.487136:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837234.487141:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb413f2e00/0x843cbef8be3050b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3050ae expref: 11 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487156:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb413f2e00/0x843cbef8be3050b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3050ae expref: 11 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487180:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487189:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487203:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487210:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487217:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487224:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487230:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030c00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837234.487233:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487239:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487247:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.487267:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837234.487296:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:3313:x1875731708646912:12345-0@lo:103: Request processed in 169us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.487323:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837234.487355:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708646912:0@lo:103: 00010000:00010000:0.0:1788837234.487918:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2e00/0x843cbef8be3050b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3050ae expref: 10 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.487931:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1875731708646528:0@lo:104: 00010000:00010000:0.0:1788837234.487958:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.487974:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.487981:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.487987:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40030c00/0x843cbef8be30519c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788837234.487999:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788837234.540593:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:6696:x1875731708646144:12345-0@lo:253: Request processed in 74611us (74741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.540606:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788837234.540739:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708646144:0@lo:253: 10000000:01000000:2.0:1788837234.540754:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788837234.540757:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837234.540759:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837234.540760:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837234.540762:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788837234.540763:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837234.540764:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837234.540766:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837234.540767:0:6696:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788837234.540769:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837234.540770:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788837234.540790:0:6696:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9acb45cdf000 from lustre-OST0000 10000000:01000000:2.0:1788837234.540812:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788837234.540815:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788837234.540821:0:6696:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9acb587319b8 local copy 10000000:01000000:2.0:1788837234.540825:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788837234.540859:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.540870:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.540879:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837234.540896:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647040:0@lo:101: 00000100:00100000:2.0:1788837234.540951:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837234.541003:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42ac6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837234.541071:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708647040 00000100:00100000:3.0:1788837234.541086:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708647040 00000100:00100000:3.0:1788837234.541125:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837234.541133:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+9:6696:x1875731708647040:12345-0@lo:101: 00010000:00010000:3.0:1788837234.541145:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837234.541159:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3051a3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.541189:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3051a3 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.541199:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3051a3 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.541207:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f3400, rc 0) 00000100:00100000:3.0:1788837234.541243:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+10:6696:x1875731708647040:12345-0@lo:101: Request processed in 110us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.541248:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837234.541434:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647040:0@lo:101: 00010000:00010000:0.0:1788837234.541448:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.541456:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.541545:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647168:0@lo:501: 00000100:00100000:0.0:1788837234.541572:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.541599:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb48857000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837234.541654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708647168 00000100:00100000:2.0:1788837234.541659:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708647168 00000100:00100000:2.0:1788837234.541690:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788837234.541696:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+10:6696:x1875731708647168:12345-0@lo:501: 00000100:00100000:2.0:1788837234.541885:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+10:6696:x1875731708647168:12345-0@lo:501: Request processed in 187us (310us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837234.541892:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788837234.542051:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647168:0@lo:501: 10000000:01000000:0.0:1788837234.542064:0:6696:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788837234.542100:0:6696:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788837234.542105:0:6696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.542123:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.542130:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.542150:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788837234.542176:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9acb45cdf000 10000000:01000000:0.0:1788837234.542182:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788837234.542186:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9acb587319b8 10000000:01000000:0.0:1788837234.542188:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788837234.542192:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9acb587319b8 from 1 10000000:01000000:0.0:1788837234.542194:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788837234.542212:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.542220:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.542227:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.542239:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647296:0@lo:101: 00000100:00100000:0.0:1788837234.542265:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.542277:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb48857300 going to sleep for 11 seconds 00010000:00010000:2.0:1788837234.542450:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837234.542457:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.542465:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ac00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:2.0:1788837234.542469:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.542476:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837234.542483:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837234.542489:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788837234.542508:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.542514:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837234.542545:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.542551:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be3051a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x843cbef8be3051aa expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.542566:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837234.542568:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837234.542576:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837234.542587:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708647296 00000100:00100000:2.0:1788837234.542592:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708647296 00000100:00100000:2.0:1788837234.542614:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788837234.542621:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+10:6696:x1875731708647296:12345-0@lo:101: 00010000:00010000:2.0:1788837234.542629:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837234.542638:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb4167a000/0x843cbef8be3051b8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3051b1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.542653:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb4167a000/0x843cbef8be3051b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3051b1 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.542663:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb4167a000/0x843cbef8be3051b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3051b1 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.542670:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167a000, rc 0) 00000100:00100000:2.0:1788837234.542698:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708647296:12345-0@lo:101: Request processed in 77us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837234.542704:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788837234.542765:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708647424:0@lo:103: 00000100:00100000:0.0:1788837234.542793:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.542845:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647296:0@lo:101: 00010000:00010000:0.0:1788837234.542863:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051b8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.542871:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3051b8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837234.542885:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788837234.542893:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051b8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.542900:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051b8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837234.542907:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788837234.542910:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837234.542914:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788837234.542917:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788837234.542929:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.542936:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.542943:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.542954:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647552:0@lo:101: 00000100:00100000:0.0:1788837234.542978:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.542989:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb48857300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837234.543192:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708647424 00000100:00100000:2.0:1788837234.543196:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708647424 00000100:00100000:3.0:1788837234.543290:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708647552 00000100:00100000:3.0:1788837234.543301:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708647552 00000100:00100000:3.0:1788837234.543350:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788837234.543356:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708647552:12345-0@lo:101: 00010000:00010000:3.0:1788837234.543363:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837234.543372:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3051bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.543386:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3051bf expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.543394:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3051bf expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.543400:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2000, rc 0) 00000100:00100000:3.0:1788837234.543429:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708647552:12345-0@lo:101: Request processed in 73us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.543434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837234.543522:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837234.543531:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:3314:x1875731708647424:12345-0@lo:103: 00010000:00010000:2.0:1788837234.543540:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837234.543551:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3051a3 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.543562:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837234.543588:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:3314:x1875731708647424:12345-0@lo:103: Request processed in 59us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837234.543600:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837234.543758:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708647424:0@lo:103: 00000100:00100000:0.0:1788837234.543798:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647552:0@lo:101: 00010000:00010000:0.0:1788837234.543809:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.543816:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.543896:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647680:0@lo:501: 00000100:00100000:0.0:1788837234.543920:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.543945:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb48857300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837234.543995:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708647680 00000100:00100000:3.0:1788837234.543999:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708647680 00000100:00100000:3.0:1788837234.544028:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788837234.544034:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708647680:12345-0@lo:501: 00000100:00100000:3.0:1788837234.544256:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708647680:12345-0@lo:501: Request processed in 222us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.544262:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788837234.544344:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647680:0@lo:501: 00000100:00100000:0.0:1788837234.544369:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647808:0@lo:503: 00000100:00100000:0.0:1788837234.544404:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.544428:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb48857300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837234.544477:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708647808 00000100:00100000:3.0:1788837234.544481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708647808 00000100:00100000:3.0:1788837234.544510:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788837234.544517:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708647808:12345-0@lo:503: 00000100:00100000:3.0:1788837234.544645:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708647808:12345-0@lo:503: Request processed in 128us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.544660:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837234.544798:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647808:0@lo:503: 00000040:00080000:0.0:1788837234.545049:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837234.545116:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647936:0@lo:502: 00000100:00100000:0.0:1788837234.545147:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.545178:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb48857300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837234.545276:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708647936 00000100:00100000:3.0:1788837234.545280:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708647936 00000100:00100000:3.0:1788837234.545335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837234.545343:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708647936:12345-0@lo:502: 00000100:00100000:3.0:1788837234.545472:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708647936:12345-0@lo:502: Request processed in 129us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.545479:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837234.545644:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708647936:0@lo:502: 00000040:00080000:0.0:1788837234.545881:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788837234.545928:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788837234.545961:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788837234.546006:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788837234.546057:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788837234.546177:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788837234.546209:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648064:0@lo:502: 00000100:00100000:0.0:1788837234.546246:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.546337:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb48857300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837234.546512:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708648064 00000100:00100000:3.0:1788837234.546517:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708648064 00000100:00100000:3.0:1788837234.546551:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788837234.546558:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708648064:12345-0@lo:502: 00000100:00100000:3.0:1788837234.546741:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708648064:12345-0@lo:502: Request processed in 182us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.546747:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837234.546919:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648064:0@lo:502: 00000040:00080000:1.0:1788837234.547012:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788837234.547022:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788837234.547842:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788837234.547850:0:6714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788837234.547857:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837234.547860:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788837234.547865:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837234.547880:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9acb798299b8) 00000020:00000080:2.0:1788837234.547900:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788837234.547906:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788837234.547973:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb45cdf000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788837234.547981:0:6714:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788837234.547997:0:6714:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x843cbef8be3051d4 00010000:00010000:3.0:1788837234.557457:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788837234.557795:0:6714:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788837234.566373:0:6714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788837234.566680:0:6714:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788837234.576272:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788837234.577051:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788837234.578944:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788837234.578955:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837234.578961:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837234.578964:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788837234.578967:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837234.578971:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837234.578972:0:6714:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837234.578975:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837234.578977:0:6714:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788837234.579024:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837234.579027:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837234.579029:0:6714:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837234.579032:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788837234.581766:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788837234.581804:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788837234.581832:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.584403:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837234.584435:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb45cdf000 from 1 10000000:01000000:1.0:1788837234.584438:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837234.584475:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.584483:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.584495:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837234.584516:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648192:0@lo:101: 00000100:00100000:1.0:1788837234.584580:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.584625:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837234.584805:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708648192 00000100:00100000:3.0:1788837234.584812:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708648192 00000100:00100000:3.0:1788837234.584857:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788837234.584867:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:6696:x1875731708648192:12345-0@lo:101: 00010000:00010000:3.0:1788837234.584880:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837234.584893:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3051db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.584923:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3051db expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.584932:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3051db expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.584940:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f3400, rc 0) 00000100:00100000:3.0:1788837234.584977:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648192:12345-0@lo:101: Request processed in 111us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.584982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837234.585222:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648192:0@lo:101: 00010000:00010000:1.0:1788837234.585236:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.585245:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837234.585409:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648320:0@lo:501: 00000100:00100000:1.0:1788837234.585437:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.585488:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837234.585993:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708648320 00000100:00100000:2.0:1788837234.585999:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708648320 00000100:00100000:2.0:1788837234.586036:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788837234.586044:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648320:12345-0@lo:501: 00000100:00100000:2.0:1788837234.586542:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648320:12345-0@lo:501: Request processed in 497us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837234.586557:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837234.586813:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648320:0@lo:501: 00000100:00100000:1.0:1788837234.586848:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648448:0@lo:503: 00000100:00100000:1.0:1788837234.586889:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.586950:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837234.589185:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708648448 00000100:00100000:2.0:1788837234.589195:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708648448 00000100:00100000:2.0:1788837234.589243:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788837234.589252:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648448:12345-0@lo:503: 00000100:00100000:2.0:1788837234.589835:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648448:12345-0@lo:503: Request processed in 581us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837234.589842:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837234.589912:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648448:0@lo:503: 00000040:00080000:1.0:1788837234.590577:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837234.590648:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648576:0@lo:502: 00000100:00100000:1.0:1788837234.590765:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.590835:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837234.590902:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708648576 00000100:00100000:2.0:1788837234.590907:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708648576 00000100:00100000:2.0:1788837234.590973:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837234.590982:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648576:12345-0@lo:502: 00000100:00100000:2.0:1788837234.591281:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648576:12345-0@lo:502: Request processed in 299us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837234.591287:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788837234.591436:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648576:0@lo:502: 00000040:00080000:1.0:1788837234.591766:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788837234.591817:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788837234.591841:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648704:0@lo:502: 00000100:00100000:1.0:1788837234.591878:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.592028:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837234.592230:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708648704 00000100:00100000:0.0:1788837234.592236:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708648704 00000100:00100000:0.0:1788837234.592264:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837234.592271:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648704:12345-0@lo:502: 00000100:00100000:0.0:1788837234.592439:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648704:12345-0@lo:502: Request processed in 167us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837234.592445:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788837234.592553:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648704:0@lo:502: 00000040:00080000:1.0:1788837234.592645:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788837234.592666:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788837234.593240:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837234.593248:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837234.593251:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788837234.593258:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb45cdf000 00000020:00000080:1.0:1788837234.593260:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788837234.593277:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837234.593280:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837234.593282:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788837234.593284:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788837234.593432:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788837234.593454:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837234.593474:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.593485:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837234.593526:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788837234.593529:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9acb45cdf000 10000000:01000000:0.0:1788837234.593532:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9acb45cdf000 10000000:01000000:0.0:1788837234.593536:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837234.593541:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb45cdf000 from 1 10000000:01000000:0.0:1788837234.593544:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837234.593569:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.593577:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.593596:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.593612:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648832:0@lo:101: 00000100:00100000:0.0:1788837234.593722:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.593755:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708648832 00000100:00100000:0.0:1788837234.593760:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708648832 00000100:00100000:0.0:1788837234.593785:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837234.593792:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708648832:12345-0@lo:101: 00010000:00010000:0.0:1788837234.593802:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837234.593813:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3051e9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.593834:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3051e9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.593845:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3051e9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.593852:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031200, rc 0) 00000100:00100000:0.0:1788837234.593880:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708648832:12345-0@lo:101: Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837234.593886:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837234.593913:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42ac6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837234.593929:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648832:0@lo:101: 00010000:00010000:0.0:1788837234.593941:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.593960:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837234.594038:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648960:0@lo:501: 00000100:00100000:0.0:1788837234.594063:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.594211:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708648960 00000100:00100000:0.0:1788837234.594215:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708648960 00000100:00100000:0.0:1788837234.594233:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837234.594238:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708648960:12345-0@lo:501: 00000100:00100000:0.0:1788837234.594444:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708648960:12345-0@lo:501: Request processed in 204us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837234.594451:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837234.594474:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837234.594486:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708648960:0@lo:501: 00000100:00100000:0.0:1788837234.594510:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708649088:0@lo:503: 00000100:00100000:0.0:1788837234.594547:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.594566:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708649088 00000100:00100000:0.0:1788837234.594570:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708649088 00000100:00100000:0.0:1788837234.594586:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837234.594591:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708649088:12345-0@lo:503: 00000100:00100000:0.0:1788837234.594876:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708649088:12345-0@lo:503: Request processed in 284us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837234.594883:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837234.594911:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837234.594924:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708649088:0@lo:503: 00000040:00080000:0.0:1788837234.595246:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837234.595337:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708649216:0@lo:502: 00000100:00100000:0.0:1788837234.595373:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.595392:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837234.595512:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708649216 00000100:00100000:2.0:1788837234.595517:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708649216 00000100:00100000:2.0:1788837234.595543:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788837234.595550:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708649216:12345-0@lo:502: 00000100:00100000:2.0:1788837234.595719:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708649216:12345-0@lo:502: Request processed in 169us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837234.595726:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788837234.595914:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708649216:0@lo:502: 00000040:00080000:0.0:1788837234.596199:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788837234.596246:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788837234.596278:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788837234.596354:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788837234.596395:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788837234.596442:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788837234.596479:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788837234.596512:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788837234.596569:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788837234.596608:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788837234.596644:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788837234.596881:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788837234.596925:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788837234.596978:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788837234.597030:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788837234.597070:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788837234.597174:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788837234.597240:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788837234.597277:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788837234.597458:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788837234.597511:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788837234.597548:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788837234.597583:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788837234.597631:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788837234.597747:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788837234.597794:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788837234.597858:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788837234.597896:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788837234.597935:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708649344:0@lo:502: 00000100:00100000:0.0:1788837234.598002:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.598037:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837234.598128:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708649344 00000100:00100000:2.0:1788837234.598135:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708649344 00000100:00100000:2.0:1788837234.598185:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837234.598195:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708649344:12345-0@lo:502: 00000100:00100000:2.0:1788837234.598435:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708649344:12345-0@lo:502: Request processed in 240us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837234.598443:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788837234.598779:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708649344:0@lo:502: 00000040:00080000:0.0:1788837234.598855:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788837234.598865:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788837234.599982:0:6719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788837234.599997:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9acb79828000) 00000020:00000080:2.0:1788837234.600016:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788837234.600301:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb45cdf000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788837234.600516:0:6719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9acb45cdf000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788837234.600518:0:6719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb45cdf000 3 00010000:00080000:2.0:1788837234.600548:0:6719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb7b4e1000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1788837234.603830:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788837234.604059:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788837234.604183:0:6719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788837234.604197:0:6719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x843cbef8be3051fe 00000100:00080000:2.0:1788837234.604207:0:6719:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837234.604213:0:6719:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9acb7b4e1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1788837234.604252:0:6719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb58747480 x1875731708649472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837234.604277:0:6719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788837234.604460:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1875731708649472:0@lo:38: 00000100:00100000:0.0:1788837234.604523:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837234.604630:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708649472 00000100:00100000:2.0:1788837234.604637:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708649472 00000100:00100000:2.0:1788837234.604683:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837234.604690:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1875731708649472:12345-0@lo:38: 00010000:00080000:2.0:1788837234.604710:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1788837234.604747:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x843cbef8be305205 00000004:00100000:2.0:1788837234.604761:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788837234.604788:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9acb7b4e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837234.604841:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875731708649472:12345-0@lo:38: Request processed in 150us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837234.604848:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788837234.604983:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9acb58747480 x1875731708649472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837234.604992:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837234.604999:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788837234.605007:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788837234.605010:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788837234.605012:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb7b4e1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788837234.605017:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1875731708649472:0@lo:38: 00000100:00100000:0.0:1788837234.605193:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708649600:0@lo:400: 00000100:00100000:0.0:1788837234.605223:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837234.605357:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708649600 00000100:00100000:3.0:1788837234.605362:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708649600 00000100:00100000:3.0:1788837234.605396:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837234.605403:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708649600:12345-0@lo:400: 00000100:00100000:3.0:1788837234.605441:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708649600:12345-0@lo:400: Request processed in 38us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.605447:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788837234.605516:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9acb7574f480 x1875731708649600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837234.605525:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708649600:0@lo:400: 00000040:00080000:2.0:1788837234.606632:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788837234.608535:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788837234.608577:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837234.608598:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837234.608610:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788837234.608768:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788837234.608771:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837234.608772:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837234.608773:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837234.608774:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837234.608776:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837234.608777:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837234.608779:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837234.608780:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837234.608782:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837234.608783:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837234.608787:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788837234.608789:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837234.608791:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837234.608792:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837234.608793:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837234.608794:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837234.608795:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837234.608796:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837234.608797:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837234.608798:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837234.608799:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837234.608800:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837234.608824:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788837234.608839:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708649728:0@lo:253: 00000100:00100000:0.0:1788837234.608897:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837234.608940:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b870c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837234.608988:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708649728 00000100:00100000:3.0:1788837234.608995:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708649728 00000100:00100000:3.0:1788837234.609039:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788837234.609048:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:6696:x1875731708649728:12345-0@lo:253: 20000000:01000000:3.0:1788837234.609102:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788837234.609117:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788837234.641938:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788837234.641958:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788837234.642765:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788837234.642771:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788837234.642792:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.642810:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb413f2800/0x843cbef8be305164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30515d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.642818:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.642854:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb413f2800/0x843cbef8be305164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30515d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837234.642868:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb413f2800/0x843cbef8be305164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30515d expref: 13 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837234.642882:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875731708649856:0@lo:104: 00000100:00100000:1.0:1788837234.642941:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837234.642997:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837234.643054:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708649856 00000100:00100000:2.0:1788837234.643062:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708649856 00000100:00100000:2.0:1788837234.643124:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837234.643134:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5860:x1875731708649856:12345-0@lo:104: 00010000:00010000:2.0:1788837234.643146:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be30515d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.643209:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837234.643215:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5860:x1875731708649856:12345-0@lo:104: Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837234.643222:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788837234.643410:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837234.643417:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be30515d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643440:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030200 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837234.643443:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be30515d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643451:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be30515d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837234.643459:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be30515d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837234.643464:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837234.643497:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be30515d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643503:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837234.643527:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be30515d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643535:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be30515d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305164 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643550:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837234.643552:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837234.643554:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837234.643561:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837234.643573:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708649984:0@lo:103: 00000100:00100000:3.0:1788837234.643607:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837234.643640:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708649984 00000100:00100000:3.0:1788837234.643643:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708649984 00010000:00010000:3.0:1788837234.643783:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb413f2800/0x843cbef8be305164 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30515d expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837234.643883:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788837234.643901:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:3315:x1875731708649984:12345-0@lo:103: 00010000:00010000:3.0:1788837234.643913:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837234.643918:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb413f2800/0x843cbef8be305164 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30515d expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643928:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb413f2800/0x843cbef8be305164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30515d expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643944:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643953:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837234.643967:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001649502s 00010000:00010000:3.0:1788837234.643971:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643977:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643984:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643990:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.643995:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb41485000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837234.644004:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.644011:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.644020:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837234.644029:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837234.644066:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:3315:x1875731708649984:12345-0@lo:103: Request processed in 176us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837234.644081:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837234.644183:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708649984:0@lo:103: 00010000:00010000:2.0:1788837234.645899:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2800/0x843cbef8be305164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30515d expref: 13 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837234.645916:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875731708649856:0@lo:104: 00010000:00010000:2.0:1788837234.645933:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.645943:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.645950:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837234.645971:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb41485000/0x843cbef8be30520c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837234.651563:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:6696:x1875731708649728:12345-0@lo:253: Request processed in 42509us (42658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837234.651577:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837234.651722:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:6696:1875731708649728:0@lo:253: 10000000:01000000:0.0:1788837234.651737:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788837234.651752:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837234.651754:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837234.651755:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837234.651756:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837234.651757:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837234.651759:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837234.651760:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837234.651761:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837234.651763:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837234.651764:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837234.651766:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788837234.651779:0:6696:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788837234.657585:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837234.658208:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788837234.658433:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837234.658623:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788837234.659674:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788837234.659942:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788837234.661990:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788837234.869520:0:6696:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788837234.869526:0:6696:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788837234.869565:0:6696:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788837234.869612:0:6696:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788837234.869643:0:6696:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788837234.869669:0:6696:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788837235.436125:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837236.453526:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837237.477710:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837238.502899:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837239.529473:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837239.660442:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708650240:0@lo:400: 00000100:00100000:0.0:1788837239.660511:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837239.660566:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837239.660572:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708650112:0@lo:400: 00000100:00100000:0.0:1788837239.660599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837239.660629:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708650368:0@lo:400: 00000100:00100000:0.0:1788837239.660652:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837239.660688:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708650240 00000100:00100000:0.0:1788837239.660695:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708650240 00000100:00100000:0.0:1788837239.660731:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708650368 00000100:00100000:0.0:1788837239.660741:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708650368 00000100:00100000:0.0:1788837239.660773:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837239.660781:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708650240:12345-0@lo:400: 00000100:00100000:0.0:1788837239.660827:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708650240:12345-0@lo:400: Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837239.660835:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837239.660850:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837239.660856:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708650368:12345-0@lo:400: 00000100:00100000:0.0:1788837239.660885:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708650368:12345-0@lo:400: Request processed in 30us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837239.660891:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837239.660908:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708650112 00000100:00100000:0.0:1788837239.660912:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708650112 00000100:00100000:0.0:1788837239.660933:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788837239.660938:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:3314:x1875731708650112:12345-0@lo:400: 00000100:00100000:0.0:1788837239.660965:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:3314:x1875731708650112:12345-0@lo:400: Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837239.660970:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788837239.661013:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb741ac380 x1875731708650368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837239.661027:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708650368:0@lo:400: 00000100:00100000:0.0:1788837239.661049:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708650112:0@lo:400: 00010000:00080000:0.0:1788837239.661058:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb741af800 x1875731708650240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837239.661066:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708650240:0@lo:400: 00000100:00080000:2.0:1788837239.668790:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837240.549918:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837240.654725:0:7063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788837241.190629:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788837241.190637:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb6a76b800 from 21 10000000:01000000:1.0:1788837241.190661:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837241.190707:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.190719:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.190729:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837241.190754:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708650496:0@lo:101: 00000100:00100000:1.0:1788837241.190835:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.190909:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d235000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837241.191477:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708650496 00000100:00100000:0.0:1788837241.191486:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708650496 00000100:00100000:0.0:1788837241.191543:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788837241.191553:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708650496:12345-0@lo:101: 00010000:00010000:0.0:1788837241.191567:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837241.191583:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305213 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837241.191609:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305213 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837241.191620:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305213 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837241.191629:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030200, rc 0) 00000100:00100000:0.0:1788837241.191693:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708650496:12345-0@lo:101: Request processed in 141us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837241.191699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788837241.191805:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708650496:0@lo:101: 00010000:00010000:2.0:1788837241.191821:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837241.191830:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837241.191884:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708650624:0@lo:501: 00000100:00100000:2.0:1788837241.191916:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837241.191948:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.193357:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708650624 00000100:00100000:1.0:1788837241.193368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708650624 00000100:00100000:1.0:1788837241.193413:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837241.193422:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708650624:12345-0@lo:501: 00000100:00100000:1.0:1788837241.193823:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708650624:12345-0@lo:501: Request processed in 401us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.193831:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837241.193881:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708650624:0@lo:501: 00000100:00100000:1.0:1788837241.193923:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708650752:0@lo:503: 00000100:00100000:1.0:1788837241.193960:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.193984:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d2359c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.194007:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708650752 00000100:00100000:1.0:1788837241.194011:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708650752 00000100:00100000:1.0:1788837241.194041:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837241.194048:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708650752:12345-0@lo:503: 00000100:00100000:1.0:1788837241.194345:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708650752:12345-0@lo:503: Request processed in 296us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.194352:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837241.194391:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708650752:0@lo:503: 00000100:00100000:1.0:1788837241.194582:0:7085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:7085:1875731708650880:0@lo:502: 00000100:00100000:1.0:1788837241.194614:0:7085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.194631:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708650880 00000100:00100000:1.0:1788837241.194634:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708650880 00000100:00100000:1.0:1788837241.194656:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788837241.194661:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7085:x1875731708650880:12345-0@lo:502: 00000100:00100000:1.0:1788837241.194834:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7085:x1875731708650880:12345-0@lo:502: Request processed in 173us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.194841:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788837241.194871:0:7085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d235a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.194883:0:7085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:7085:1875731708650880:0@lo:502: 00000100:00100000:1.0:1788837241.194917:0:7085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:7085:1875731708651008:0@lo:502: 00000100:00100000:1.0:1788837241.194949:0:7085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.194967:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708651008 00000100:00100000:1.0:1788837241.194970:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708651008 00000100:00100000:1.0:1788837241.194989:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837241.194995:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7085:x1875731708651008:12345-0@lo:502: 00000100:00100000:1.0:1788837241.195103:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7085:x1875731708651008:12345-0@lo:502: Request processed in 107us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.195109:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837241.195147:0:7085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb436b43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.195166:0:7085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:7085:1875731708651008:0@lo:502: 00000040:00080000:1.0:1788837241.195183:0:7085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788837241.195230:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788837241.195245:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837241.195254:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195264:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837241.195272:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788837241.195275:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9acb6a76b800 from 4 10000000:01000000:1.0:1788837241.195277:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788837241.195299:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195327:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195336:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837241.195348:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651136:0@lo:101: 00000100:00100000:1.0:1788837241.195374:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.195387:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb436b43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.195398:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708651136 00000100:00100000:1.0:1788837241.195401:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708651136 00000100:00100000:1.0:1788837241.195421:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837241.195428:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708651136:12345-0@lo:101: 00010000:00010000:1.0:1788837241.195436:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837241.195454:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305221 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195474:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305221 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195484:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305221 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195492:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb41485e00, rc 0) 00000100:00100000:1.0:1788837241.195518:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708651136:12345-0@lo:101: Request processed in 91us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.195523:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837241.195546:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651136:0@lo:101: 00010000:00010000:1.0:1788837241.195556:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195564:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837241.195601:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651264:0@lo:256: 00000100:00100000:1.0:1788837241.195628:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.195640:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb436b43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.195651:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708651264 00000100:00100000:1.0:1788837241.195654:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708651264 00000100:00100000:1.0:1788837241.195673:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788837241.195679:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708651264:12345-0@lo:256: 20000000:01000000:1.0:1788837241.195692:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788837241.195707:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788837241.195714:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788837241.195780:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708651264:12345-0@lo:256: Request processed in 100us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.195786:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788837241.195815:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651264:0@lo:256: 10000000:01000000:1.0:1788837241.195853:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788837241.195858:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195865:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837241.195871:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788837241.195873:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788837241.195875:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788837241.195889:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195896:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.195903:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837241.195913:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651392:0@lo:101: 00000100:00100000:1.0:1788837241.195936:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.195948:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb436b43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.195958:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708651392 00000100:00100000:1.0:1788837241.195962:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708651392 00000100:00100000:1.0:1788837241.195982:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837241.195995:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708651392:12345-0@lo:101: 00010000:00010000:1.0:1788837241.196001:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837241.196010:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30522f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.196024:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30522f expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.196032:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30522f expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.196039:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb41484200, rc 0) 00000100:00100000:1.0:1788837241.196067:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708651392:12345-0@lo:101: Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.196073:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837241.196103:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651392:0@lo:101: 00010000:00010000:1.0:1788837241.196113:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.196133:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837241.196169:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651520:0@lo:501: 00000100:00100000:1.0:1788837241.196191:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.196203:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb602920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.196214:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708651520 00000100:00100000:1.0:1788837241.196217:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708651520 00000100:00100000:1.0:1788837241.196236:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788837241.196242:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708651520:12345-0@lo:501: 00000100:00100000:1.0:1788837241.196468:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708651520:12345-0@lo:501: Request processed in 226us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.196475:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788837241.196501:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651520:0@lo:501: 00000100:00100000:1.0:1788837241.196522:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651648:0@lo:503: 00000100:00100000:1.0:1788837241.196552:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.196564:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb602920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.196573:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708651648 00000100:00100000:1.0:1788837241.196576:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708651648 00000100:00100000:1.0:1788837241.196593:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788837241.196599:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708651648:12345-0@lo:503: 00000100:00100000:1.0:1788837241.196853:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708651648:12345-0@lo:503: Request processed in 254us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.196860:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788837241.196894:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708651648:0@lo:503: 00000100:00100000:1.0:1788837241.200703:0:7086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:7086:1875731708651776:0@lo:502: 00000100:00100000:1.0:1788837241.201749:0:7086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.201876:0:7086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb60292d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837241.201922:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708651776 00000100:00100000:3.0:1788837241.201930:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708651776 00000100:00100000:3.0:1788837241.201977:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788837241.201986:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:7086:x1875731708651776:12345-0@lo:502: 00000100:00100000:3.0:1788837241.202372:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:7086:x1875731708651776:12345-0@lo:502: Request processed in 386us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837241.202380:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788837241.203578:0:7086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:7086:1875731708651776:0@lo:502: 00000020:01000000:1.0:1788837241.203616:0:7086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788837241.203624:0:7086:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788837241.203632:0:7086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837241.203634:0:7086:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788837241.203638:0:7086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788837241.203642:0:7086:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:1.0:1788837241.203663:0:7086:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788837241.203675:0:7086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837241.203689:0:7086:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9acb5d3519b8) 00000020:00000080:1.0:1788837241.203720:0:7086:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788837241.203725:0:7086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788837241.203817:0:7086:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788837241.203822:0:7086:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788837241.203828:0:7086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be305244 00010000:00080000:1.0:1788837241.203855:0:7086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb48a17000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1788837241.204273:0:7086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788837241.284526:0:7086:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788837241.284544:0:7086:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788837241.287034:0:7086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837241.288749:0:7086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837241.288807:0:7086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788837241.289712:0:7086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788837241.291743:0:7090:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837241.291749:0:7090:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788837241.293246:0:7086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837241.293261:0:7086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788837241.293294:0:7086:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788837241.293344:0:7086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be30524b 00000100:00080000:3.0:1788837241.293355:0:7086:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837241.293361:0:7086:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9acb48a17000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1788837241.293401:0:7086:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb7574ea00 x1875731708651904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837241.293424:0:7086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788837241.293482:0:7086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837241.293486:0:7086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837241.293488:0:7086:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788837241.293490:0:7086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837241.293494:0:7086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837241.293495:0:7086:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788837241.293497:0:7086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788837241.293499:0:7086:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788837241.293525:0:7086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:7086:1875731708652032:0@lo:502: 00000100:00100000:0.0:1788837241.293809:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708651904:0@lo:8: 00000100:00100000:1.0:1788837241.295756:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708652288:0@lo:400: 00000100:00100000:3.0:1788837241.296286:0:7086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837241.296392:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708652032 00000100:00100000:2.0:1788837241.296400:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708652032 00000100:00100000:2.0:1788837241.296447:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837241.296456:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:7086:x1875731708652032:12345-0@lo:502: 00000100:00100000:0.0:1788837241.299602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837241.299682:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708652160:0@lo:400: 00000100:00100000:0.0:1788837241.299739:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837241.299798:0:7086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42b98840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837241.299817:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708651904 00000100:00100000:0.0:1788837241.299825:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708651904 00000100:00100000:0.0:1788837241.299868:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837241.299876:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1875731708651904:12345-0@lo:8: 00010000:00080000:0.0:1788837241.299905:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1788837241.299937:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be305252 00002000:00100000:0.0:1788837241.299994:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9aca4139d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788837241.299999:0:6698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788837241.300002:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788837241.300156:0:6698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788837241.300334:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788837241.300360:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9aca4139e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837241.300408:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875731708651904:12345-0@lo:8: Request processed in 531us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837241.300416:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837241.300442:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708652160 00000100:00100000:0.0:1788837241.300446:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708652160 00000100:00100000:0.0:1788837241.300474:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837241.300481:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708652160:12345-0@lo:400: 00000100:00100000:0.0:1788837241.300518:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708652160:12345-0@lo:400: Request processed in 37us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837241.300525:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788837241.300558:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb58744a80 x1875731708652160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837241.300571:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708652160:0@lo:400: 00010000:00080000:0.0:1788837241.300608:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb7574ea00 x1875731708651904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837241.300616:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837241.300622:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788837241.300630:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788837241.300634:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788837241.300637:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb48a17000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788837241.300658:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788837241.300663:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708651904:0@lo:8: 00000004:00080000:0.0:1788837241.303212:0:7090:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788837241.304193:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:7086:x1875731708652032:12345-0@lo:502: Request processed in 7661us (7831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837241.304224:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1788837241.304251:0:7090:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 195154945931ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788837241.304297:0:7086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:7086:1875731708652032:0@lo:502: 00000020:01000000:2.0:1788837241.304357:0:7086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837241.304365:0:7086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837241.304367:0:7086:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837241.304372:0:7086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788837241.306386:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788837241.306915:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788837241.306926:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.306939:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837241.306950:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788837241.306953:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9acb587319b8 from 1 10000000:01000000:1.0:1788837241.306956:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788837241.306990:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.306999:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.307010:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837241.307031:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708652416:0@lo:101: 00000100:00100000:1.0:1788837241.309281:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.309337:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb602923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.309366:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708652416 00000100:00100000:1.0:1788837241.309372:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708652416 00000100:00100000:1.0:1788837241.309410:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788837241.309417:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708652416:12345-0@lo:101: 00010000:00010000:1.0:1788837241.309431:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837241.309448:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305259 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.309475:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305259 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.309486:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305259 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.309494:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb41484600, rc 0) 00000100:00100000:1.0:1788837241.309530:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708652416:12345-0@lo:101: Request processed in 112us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.309536:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788837241.309579:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708652416:0@lo:101: 00010000:00010000:1.0:1788837241.309593:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.309602:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837241.309656:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708652544:0@lo:501: 00000100:00100000:1.0:1788837241.309691:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.309706:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb602923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.309726:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.309769:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708652288 00000100:00100000:1.0:1788837241.309773:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708652288 00000100:00100000:1.0:1788837241.309807:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837241.309815:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708652288:12345-0@lo:400: 00000100:00100000:1.0:1788837241.310252:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708652288:12345-0@lo:400: Request processed in 437us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.310260:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788837241.310279:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788837241.310301:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb58745180 x1875731708652288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837241.310334:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708652288:0@lo:400: 00000100:00100000:1.0:1788837241.310360:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708652544 00000100:00100000:1.0:1788837241.310363:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708652544 00000100:00100000:1.0:1788837241.310393:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788837241.310401:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708652544:12345-0@lo:501: 00000100:00100000:1.0:1788837241.310579:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708652544:12345-0@lo:501: Request processed in 179us (887us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837241.310586:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788837241.310623:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708652544:0@lo:501: 10000000:01000000:1.0:1788837241.310653:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788837241.310661:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837241.310670:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837241.371190:0:7091:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788837241.371219:0:7091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7091:1875731708652800:0@lo:7: 00000100:00100000:1.0:1788837241.371220:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708652672:0@lo:13: 00000100:00100000:1.0:1788837241.371297:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837241.371299:0:7091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837241.371416:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708652800 00000100:00100000:3.0:1788837241.371424:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708652800 00000100:00080000:2.0:1788837241.371458:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837241.371481:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837241.371490:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7091:x1875731708652800:12345-0@lo:7: 00000100:00100000:0.0:1788837241.372881:0:7091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.373906:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708652672 00000100:00100000:1.0:1788837241.373916:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708652672 00000100:00100000:1.0:1788837241.373965:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837241.373976:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875731708652672:12345-0@lo:13: 00002000:00000024:1.0:1788837241.374007:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00010000:00080000:2.0:1788837241.375108:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb741ac380 x1875731708652672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837241.375143:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708652672:0@lo:13: 00000100:00100000:1.0:1788837241.375186:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875731708652672:12345-0@lo:13: Request processed in 1210us (3890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837241.375195:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:3.0:1788837241.393724:0:6701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788837241.393735:0:6701:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788837241.393828:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7091:x1875731708652800:12345-0@lo:7: Request processed in 22335us (22530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837241.393839:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788837241.393912:0:7091:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb741af100 x1875731708652800/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837241.393927:0:7091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7091:1875731708652800:0@lo:7: 00000004:00080000:3.0:1788837241.393944:0:7091:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788837241.393983:0:7091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7091:1875731708652928:0@lo:5: 00000100:00100000:3.0:1788837241.394386:0:7091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837241.394428:0:7091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42b983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837241.394446:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708652928 00000100:00100000:3.0:1788837241.394452:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708652928 00000100:00100000:3.0:1788837241.394490:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837241.394499:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7091:x1875731708652928:12345-0@lo:5: 00002000:00080000:3.0:1788837241.394523:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788837241.394526:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788837241.394787:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7091:x1875731708652928:12345-0@lo:5: Request processed in 289us (760us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788837241.394795:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788837241.394821:0:7091:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb7574fb80 x1875731708652928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837241.394835:0:7091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7091:1875731708652928:0@lo:5: 00000004:00080000:1.0:1788837241.394845:0:7091:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788837241.394872:0:7091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7091:1875731708653056:0@lo:700: 00000100:00100000:1.0:1788837241.395074:0:7091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.395106:0:7091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb480a06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837241.395171:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708653056 00000100:00100000:3.0:1788837241.395177:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708653056 00000100:00100000:3.0:1788837241.395209:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837241.395216:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7091:x1875731708653056:12345-0@lo:700: 00000100:00100000:3.0:1788837241.395243:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6707:1875731708653184:0@lo:700: 00000100:00100000:3.0:1788837241.395275:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837241.395298:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42b98600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837241.395395:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708653184 00000100:00100000:1.0:1788837241.395400:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708653184 00000100:00100000:1.0:1788837241.395439:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837241.395507:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6707:x1875731708653184:12345-0@lo:700: 00000004:00080000:2.0:1788837241.404726:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788837241.426359:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788837241.429897:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6707:x1875731708653184:12345-0@lo:700: Request processed in 34443us (34613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837241.429915:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788837241.429970:0:6707:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb7574c380 x1875731708653184/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788837257 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837241.429984:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6707:1875731708653184:0@lo:700: 40000000:02000000:3.0:1788837241.429996:0:6707:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:2.0:1788837241.483575:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788837241.483613:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1788837241.484060:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7091:x1875731708653056:12345-0@lo:700: Request processed in 88837us (88978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837241.484083:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788837241.484181:0:7091:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb457abb80 x1875731708653056/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788837257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837241.484195:0:7091:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788837241.484226:0:7091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7091:1875731708653056:0@lo:700: 00000004:02000040:1.0:1788837241.522576:0:7091:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788837241.533253:0:7091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7091:1875731708653312:0@lo:5: 00000100:00100000:1.0:1788837241.533594:0:7091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837241.533642:0:7091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb480a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837241.533697:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708653312 00000100:00100000:0.0:1788837241.533705:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708653312 00000100:00100000:0.0:1788837241.533760:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837241.533771:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7091:x1875731708653312:12345-0@lo:5: 00002000:00080000:1.0:1788837241.541194:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788837241.541214:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788837241.546510:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7091:x1875731708653312:12345-0@lo:5: Request processed in 12733us (12909us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788837241.546528:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788837241.547233:0:7091:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb457abb80 x1875731708653312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837257 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837241.547251:0:7091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7091:1875731708653312:0@lo:5: 00000004:00080000:0.0:1788837241.547264:0:7091:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788837241.573855:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837242.597595:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837243.621903:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837244.651604:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788837245.531621:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788837245.673842:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837246.310049:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708653440:0@lo:400: 00000100:00100000:0.0:1788837246.310127:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837246.310137:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708653824:0@lo:400: 00000100:00100000:3.0:1788837246.310178:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837246.310187:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837246.310193:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708653568:0@lo:400: 00000100:00100000:3.0:1788837246.310198:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837246.310203:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708653696:0@lo:400: 00000100:00100000:0.0:1788837246.310236:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837246.310273:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708653440 00000100:00100000:0.0:1788837246.310280:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708653440 00000100:00100000:0.0:1788837246.310348:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837246.310357:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3315:x1875731708653440:12345-0@lo:400: 00000100:00100000:0.0:1788837246.310416:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3315:x1875731708653440:12345-0@lo:400: Request processed in 60us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837246.310424:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788837246.310441:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837246.310455:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708653568 00000100:00100000:0.0:1788837246.310458:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708653568 00000100:00100000:3.0:1788837246.310467:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708653824 00000100:00100000:3.0:1788837246.310470:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708653824 00000100:00100000:0.0:1788837246.310481:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708653696 00000100:00100000:0.0:1788837246.310483:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708653696 00000100:00100000:0.0:1788837246.310497:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837246.310501:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837246.310503:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708653568:12345-0@lo:400: 00000100:00100000:3.0:1788837246.310507:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708653824:12345-0@lo:400: 00000100:00100000:0.0:1788837246.310533:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708653568:12345-0@lo:400: Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837246.310534:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708653824:12345-0@lo:400: Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837246.310540:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837246.310540:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837246.310552:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837246.310557:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788837246.310558:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708653696:12345-0@lo:400: 00000100:00100000:3.0:1788837246.310563:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1788837246.310576:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837246.310580:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837246.310583:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708653696:12345-0@lo:400: Request processed in 26us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837246.310588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788837246.310623:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb7574c700 x1875731708653568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837246.310636:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708653568:0@lo:400: 00000100:00100000:0.0:1788837246.310645:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708653440:0@lo:400: 00010000:00080000:3.0:1788837246.310660:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb7574d880 x1875731708653696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837246.310669:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708653696:0@lo:400: 00010000:00080000:3.0:1788837246.310679:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb7574c000 x1875731708653824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837246.310687:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788837246.310696:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708653824:0@lo:400: 00010000:00010000:3.0:1788837246.705528:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837246.821534:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837246.821558:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708653952:0@lo:13: 00000100:00100000:2.0:1788837246.821623:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837246.821750:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708653952 00000100:00100000:0.0:1788837246.821758:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708653952 00000100:00100000:0.0:1788837246.821810:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837246.821820:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708653952:12345-0@lo:13: 00002000:00000024:0.0:1788837246.821851:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837246.821905:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708653952:12345-0@lo:13: Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837246.821912:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788837246.821948:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb58747800 x1875731708653952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837246.821966:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708653952:0@lo:13: 00010000:00010000:0.0:1788837247.727441:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837248.746525:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837249.766299:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837250.799670:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837251.430529:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708654464:0@lo:400: 00000100:00100000:0.0:1788837251.430595:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.430652:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837251.430659:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708654080:0@lo:400: 00000100:00100000:0.0:1788837251.430686:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.430713:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708654208:0@lo:400: 00000100:00100000:0.0:1788837251.430761:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.430779:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837251.430784:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708654336:0@lo:400: 00000100:00100000:0.0:1788837251.430805:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.430833:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708654208 00000100:00100000:0.0:1788837251.430840:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708654208 00000100:00100000:0.0:1788837251.430876:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708654336 00000100:00100000:0.0:1788837251.430879:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708654336 00000100:00100000:0.0:1788837251.430904:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837251.430912:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708654208:12345-0@lo:400: 00000100:00100000:0.0:1788837251.430958:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708654208:12345-0@lo:400: Request processed in 47us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837251.430977:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837251.431012:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837251.431019:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708654336:12345-0@lo:400: 00000100:00100000:0.0:1788837251.431048:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708654336:12345-0@lo:400: Request processed in 30us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837251.431071:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788837251.431092:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788837251.431116:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb741ac700 x1875731708654336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837251.431129:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708654336:0@lo:400: 00010000:00080000:0.0:1788837251.431139:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb741ad880 x1875731708654208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837251.431148:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708654208:0@lo:400: 00000100:00100000:0.0:1788837251.433559:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708654464 00000100:00100000:0.0:1788837251.433573:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708654464 00000100:00100000:0.0:1788837251.433634:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837251.433645:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708654464:12345-0@lo:400: 00000100:00100000:0.0:1788837251.433720:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708654464:12345-0@lo:400: Request processed in 78us (3125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837251.433728:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788837251.433750:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837251.433778:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb741af100 x1875731708654464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837251.433792:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708654464:0@lo:400: 00000100:00100000:2.0:1788837251.434422:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708654080 00000100:00100000:2.0:1788837251.434428:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708654080 00000100:00100000:2.0:1788837251.435239:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837251.435250:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3315:x1875731708654080:12345-0@lo:400: 00000100:00100000:2.0:1788837251.435397:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3315:x1875731708654080:12345-0@lo:400: Request processed in 148us (4708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837251.435404:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788837251.435597:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708654080:0@lo:400: 00000020:01000004:2.0:1788837251.564393:0:7635:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788837251.564397:0:7635:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788837251.564525:0:7635:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9acb79181000 00000020:01000004:2.0:1788837251.564554:0:7635:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788837251.564564:0:7635:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788837251.564585:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9acb79064d28) 00000020:00000080:2.0:1788837251.564601:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788837251.592942:0:7635:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788837251.593622:0:7635:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788837251.622004:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788837251.627202:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788837251.627232:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788837251.627598:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788837251.627625:0:7635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788837251.628410:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788837251.628421:0:7635:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788837251.628535:0:7635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x843cbef8be30526e 00000020:01000004:3.0:1788837251.628595:0:7635:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788837251.628617:0:7635:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788837251.628620:0:7635:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788837251.628626:0:7635:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788837251.628644:0:7635:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788837251.628647:0:7635:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788837251.653004:0:7635:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788837251.653040:0:7635:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788837251.653044:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788837251.653046:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837251.653047:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837251.653048:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837251.653049:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837251.653050:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837251.653061:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837251.653063:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788837251.653064:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788837251.653065:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837251.653067:0:7635:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788837251.653070:0:7635:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788837251.653073:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788837251.653078:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837251.653079:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837251.653080:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837251.653081:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837251.653082:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837251.653083:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837251.653083:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788837251.653084:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788837251.653085:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837251.653086:0:7635:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788837251.653121:0:7635:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788837251.653139:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708654592:0@lo:253: 00000100:00100000:3.0:1788837251.653203:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.653290:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837251.653394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708654592 00000100:00100000:0.0:1788837251.653419:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708654592 00000100:00100000:0.0:1788837251.653577:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788837251.653587:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:7635:x1875731708654592:12345-0@lo:253: 20000000:01000000:0.0:1788837251.653617:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788837251.653620:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788837251.653625:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788837251.653629:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788837251.654734:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837251.655005:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788837251.655020:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788837251.655070:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788837251.655078:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788837251.655108:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788837251.655154:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788837251.655615:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788837251.655633:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:0.0:1788837251.655636:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1788837251.655682:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788837251.655690:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788837251.655734:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788837251.655743:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1788837251.655774:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788837251.655783:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788837251.655811:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788837251.655858:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788837251.659851:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788837251.659883:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:0.0:1788837251.659886:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1788837251.659922:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788837251.659929:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788837251.659955:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788837251.659973:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1788837251.660003:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788837251.660011:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788837251.660553:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788837251.660606:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788837251.660624:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788837251.660627:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788837251.660631:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788837251.660643:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788837251.660645:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788837251.660680:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788837251.660682:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788837251.662760:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788837251.662842:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788837251.662896:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788837251.664029:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788837251.664092:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788837251.664126:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788837251.664142:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788837251.664145:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788837251.665116:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788837251.665183:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788837251.665212:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788837251.665516:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788837251.665559:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788837251.665611:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788837251.665625:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788837251.665627:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788837251.666084:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788837251.666298:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788837251.666440:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788837251.666498:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788837251.666512:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788837251.666514:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788837251.667178:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788837251.667224:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788837251.667278:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788837251.668841:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788837251.668958:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788837251.669031:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788837251.669078:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788837251.669080:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788837251.669088:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788837251.669105:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669120:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3051bf expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669127:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3051e9 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669133:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305213 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669139:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30522f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669145:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305259 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669152:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669196:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305259 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669210:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305259 expref: 16 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.669222:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708654720:0@lo:104: 00000100:00100000:1.0:1788837251.669282:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837251.669364:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30522f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669373:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30522f expref: 16 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.669381:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708654848:0@lo:104: 00010000:00010000:1.0:1788837251.669401:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305213 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669408:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305213 expref: 16 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.669415:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708654976:0@lo:104: 00010000:00010000:1.0:1788837251.669432:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3051e9 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669439:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3051e9 expref: 16 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.669446:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708655104:0@lo:104: 00010000:00010000:1.0:1788837251.669465:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3051bf expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.669473:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3051bf expref: 16 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.669481:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708655232:0@lo:104: 00000100:00100000:1.0:1788837251.669496:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42b98780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837251.669860:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788837251.669878:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.669900:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.669908:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.669922:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.669932:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708654720 00000100:00100000:3.0:1788837251.669937:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708654720 00000100:00100000:3.0:1788837251.669964:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708654848 00000100:00100000:3.0:1788837251.669967:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708654848 00000100:00100000:3.0:1788837251.669977:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708654976 00000100:00100000:3.0:1788837251.669978:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708654976 00000100:00100000:3.0:1788837251.669988:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708655104 00000100:00100000:3.0:1788837251.669990:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708655104 00000100:00100000:3.0:1788837251.669997:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708655232 00000100:00100000:3.0:1788837251.669999:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708655232 00000100:00100000:3.0:1788837251.670011:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837251.670018:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb430e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+7:5837:x1875731708654720:12345-0@lo:104: 00010000:00010000:3.0:1788837251.670039:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670103:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837251.670109:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb430e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+7:5837:x1875731708654720:12345-0@lo:104: Request processed in 92us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.670116:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837251.670151:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837251.670157:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+6:5837:x1875731708654848:12345-0@lo:104: 00010000:00010000:3.0:1788837251.670164:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670192:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837251.670197:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+6:5837:x1875731708654848:12345-0@lo:104: Request processed in 41us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.670202:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837251.670213:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837251.670218:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:5837:x1875731708654976:12345-0@lo:104: 00010000:00010000:3.0:1788837251.670225:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670246:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788837251.670250:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:5837:x1875731708654976:12345-0@lo:104: Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.670256:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837251.670266:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837251.670271:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:5837:x1875731708655104:12345-0@lo:104: 00010000:00010000:3.0:1788837251.670282:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670328:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788837251.670334:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:5837:x1875731708655104:12345-0@lo:104: Request processed in 63us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.670340:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837251.670351:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837251.670356:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5837:x1875731708655232:12345-0@lo:104: 00010000:00010000:3.0:1788837251.670362:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670385:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788837251.670389:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5837:x1875731708655232:12345-0@lo:104: Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.670393:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788837251.670407:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788837251.670413:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670419:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb41485200 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837251.670422:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670429:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837251.670436:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837251.670448:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837251.670474:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670480:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837251.670498:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670504:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb41485200/0x843cbef8be305259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305260 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670516:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788837251.670519:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670524:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb41485a00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837251.670527:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670533:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837251.670539:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837251.670544:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837251.670554:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670559:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837251.670580:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670588:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb41485a00/0x843cbef8be30522f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305236 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670598:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788837251.670601:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670606:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb41484a00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837251.670610:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670617:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837251.670623:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837251.670628:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837251.670639:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670644:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837251.670648:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670654:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb41484a00/0x843cbef8be305213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30521a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670662:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837251.670670:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670676:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030600 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837251.670678:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670684:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837251.670689:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837251.670694:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837251.670705:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670711:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837251.670716:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670721:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb40030600/0x843cbef8be3051e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3051f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670730:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837251.670733:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670738:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030a00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837251.670740:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670754:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837251.670761:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837251.670767:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837251.670779:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670785:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837251.670789:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670795:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb40030a00/0x843cbef8be3051bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3051c6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.670807:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837251.670808:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837251.670810:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837251.670817:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837251.670834:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708655360:0@lo:103: 00000100:00100000:3.0:1788837251.670863:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.670881:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708655872:0@lo:103: 00000100:00100000:3.0:1788837251.670900:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.670916:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837251.670921:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708655744:0@lo:103: 00000100:00100000:3.0:1788837251.670938:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.670972:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708655488:0@lo:103: 00000100:00100000:3.0:1788837251.671006:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.671019:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837251.671024:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708655616:0@lo:103: 00000100:00100000:3.0:1788837251.671043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.671082:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708655360 00000100:00100000:3.0:1788837251.671086:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708655360 00010000:00010000:3.0:1788837251.671103:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305259 expref: 17 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837251.671116:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708655872 00000100:00100000:3.0:1788837251.671119:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708655872 00010000:00010000:3.0:1788837251.671128:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3051bf expref: 18 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837251.671138:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708655744 00000100:00100000:3.0:1788837251.671140:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708655744 00010000:00010000:3.0:1788837251.671148:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3051e9 expref: 19 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837251.671157:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708655488 00000100:00100000:3.0:1788837251.671159:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708655488 00010000:00010000:3.0:1788837251.671166:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30522f expref: 20 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837251.671175:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708655616 00000100:00100000:3.0:1788837251.671178:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708655616 00010000:00010000:3.0:1788837251.671186:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305213 expref: 21 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837251.671199:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837251.671205:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+21:3316:x1875731708655360:12345-0@lo:103: 00010000:00010000:3.0:1788837251.671220:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837251.671226:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305259 expref: 21 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671237:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305259 expref: 21 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671251:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837251.671278:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+21:3316:x1875731708655360:12345-0@lo:103: Request processed in 73us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.671284:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837251.671297:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837251.671322:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3316:x1875731708655872:12345-0@lo:103: 00010000:00010000:3.0:1788837251.671330:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837251.671335:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3051bf expref: 20 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671343:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3051bf expref: 20 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671353:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837251.671373:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3316:x1875731708655872:12345-0@lo:103: Request processed in 70us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.671379:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837251.671390:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837251.671396:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708655744:12345-0@lo:103: 00010000:00010000:3.0:1788837251.671403:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837251.671407:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3051e9 expref: 19 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671420:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3051e9 expref: 19 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671430:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837251.671450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708655744:12345-0@lo:103: Request processed in 54us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.671457:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837251.671469:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837251.671476:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3313:x1875731708655488:12345-0@lo:103: 00010000:00010000:3.0:1788837251.671483:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837251.671488:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30522f expref: 18 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671497:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30522f expref: 18 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671505:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837251.671528:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3313:x1875731708655488:12345-0@lo:103: Request processed in 53us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.671533:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837251.671545:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837251.671551:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:3313:x1875731708655616:12345-0@lo:103: 00010000:00010000:3.0:1788837251.671557:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837251.671561:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305213 expref: 17 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671570:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305213 expref: 17 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671587:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671596:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671608:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671615:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671621:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671627:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671632:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837251.671636:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671642:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671649:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.671656:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837251.671681:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:3313:x1875731708655616:12345-0@lo:103: Request processed in 131us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.671696:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837251.671733:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708655616:0@lo:103: 00000100:00100000:3.0:1788837251.671740:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708655488:0@lo:103: 00000100:00100000:3.0:1788837251.671763:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708655744:0@lo:103: 00000100:00100000:3.0:1788837251.671769:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708655360:0@lo:103: 00000100:00100000:3.0:1788837251.671775:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708655872:0@lo:103: 00010000:00010000:1.0:1788837251.671953:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb41484600/0x843cbef8be305260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305259 expref: 16 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.671972:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708654720:0@lo:104: 00010000:00010000:1.0:1788837251.671983:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb41484200/0x843cbef8be305236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30522f expref: 15 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.671990:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708654848:0@lo:104: 00010000:00010000:1.0:1788837251.671998:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40030200/0x843cbef8be30521a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305213 expref: 14 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.672004:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708654976:0@lo:104: 00010000:00010000:1.0:1788837251.672012:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40031200/0x843cbef8be3051f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3051e9 expref: 13 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.672021:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708655104:0@lo:104: 00010000:00010000:1.0:1788837251.672029:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2000/0x843cbef8be3051c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3051bf expref: 12 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.672036:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875731708655232:0@lo:104: 00010000:00010000:1.0:1788837251.672061:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.672069:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.672075:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.672081:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f577400/0x843cbef8be305275 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788837251.672099:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788837251.701388:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:7635:x1875731708654592:12345-0@lo:253: Request processed in 47795us (48176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.701401:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788837251.701541:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708654592:0@lo:253: 10000000:01000000:2.0:1788837251.701553:0:7635:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788837251.701555:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837251.701556:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788837251.701557:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837251.701558:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788837251.701559:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837251.701559:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837251.701561:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837251.701562:0:7635:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788837251.701563:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837251.701564:0:7635:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788837251.701578:0:7635:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9acb79181000 from lustre-OST0001 10000000:01000000:2.0:1788837251.701595:0:7635:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788837251.701596:0:7635:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788837251.701602:0:7635:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9acb587319b8 local copy 10000000:01000000:2.0:1788837251.701605:0:7635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788837251.701632:0:7635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.701639:0:7635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.701646:0:7635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837251.701658:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656000:0@lo:101: 00000100:00100000:2.0:1788837251.701682:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837251.701717:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788837251.701721:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708656000 00000100:00100000:0.0:1788837251.701728:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708656000 00000100:00100000:0.0:1788837251.701774:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788837251.701783:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+11:7635:x1875731708656000:12345-0@lo:101: 00010000:00010000:0.0:1788837251.701795:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837251.701809:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb40030a00/0x843cbef8be305283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30527c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.701903:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb40030a00/0x843cbef8be305283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30527c expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.702098:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb40030a00/0x843cbef8be305283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30527c expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.702107:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030a00, rc 0) 00000100:00100000:0.0:1788837251.702147:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656000:12345-0@lo:101: Request processed in 366us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837251.702153:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788837251.702175:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656000:0@lo:101: 00010000:00010000:2.0:1788837251.702187:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.702196:0:7635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837251.702280:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656128:0@lo:501: 00000100:00100000:2.0:1788837251.702705:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837251.702732:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837251.703877:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708656128 00000100:00100000:3.0:1788837251.703887:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708656128 00000100:00100000:3.0:1788837251.704066:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788837251.704076:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656128:12345-0@lo:501: 00000100:00100000:3.0:1788837251.704344:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656128:12345-0@lo:501: Request processed in 269us (1639us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837251.704345:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656128:0@lo:501: 00000100:00100000:3.0:1788837251.704352:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 10000000:01000000:2.0:1788837251.704363:0:7635:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788837251.704392:0:7635:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788837251.704399:0:7635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.704410:0:7635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.704417:0:7635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.704444:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788837251.704466:0:7635:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9acb79181000 10000000:01000000:2.0:1788837251.704471:0:7635:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788837251.704476:0:7635:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788837251.704479:0:7635:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837251.704483:0:7635:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788837251.704493:0:7635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788837251.704515:0:7635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.704522:0:7635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.704531:0:7635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837251.704546:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656256:0@lo:101: 00000100:00100000:2.0:1788837251.704580:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837251.704612:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f840 going to sleep for 11 seconds 00010000:00010000:3.0:1788837251.704638:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837251.704644:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.704652:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ac00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837251.704655:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.704663:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837251.704677:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837251.704686:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788837251.704704:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708656256 00010000:00010000:3.0:1788837251.704705:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837251.704708:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708656256 00010000:00010000:3.0:1788837251.704711:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788837251.704735:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00010000:00010000:3.0:1788837251.704739:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837251.704742:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656256:12345-0@lo:101: 00010000:00010000:3.0:1788837251.704746:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be30527c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x843cbef8be305283 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.704750:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837251.704758:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837251.704760:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837251.704761:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837251.704761:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30528a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837251.704768:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837251.704777:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708656384:0@lo:103: 00000100:00100000:3.0:1788837251.704804:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837251.704971:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30528a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.704982:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30528a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.704991:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030600, rc 0) 00000100:00100000:3.0:1788837251.705148:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708656384 00000100:00100000:3.0:1788837251.705152:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708656384 00000100:00100000:0.0:1788837251.705162:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708656256:12345-0@lo:101: Request processed in 420us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837251.705168:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788837251.705187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837251.705194:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:3314:x1875731708656384:12345-0@lo:103: 00010000:00010000:3.0:1788837251.705202:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837251.705214:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40030a00/0x843cbef8be305283 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be30527c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.705224:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837251.705253:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656256:0@lo:101: 00000100:00100000:3.0:1788837251.705263:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:3314:x1875731708656384:12345-0@lo:103: Request processed in 71us (459us total) trans 0 rc 0/0 00010000:00010000:1.0:1788837251.705265:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837251.705269:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788837251.705273:0:7635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837251.705344:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708656384:0@lo:103: 00000100:00100000:1.0:1788837251.705397:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656512:0@lo:501: 00000100:00100000:1.0:1788837251.705423:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837251.705547:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42b98780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837251.705548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708656512 00000100:00100000:3.0:1788837251.705552:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708656512 00000100:00100000:3.0:1788837251.705579:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788837251.705585:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656512:12345-0@lo:501: 00000100:00100000:3.0:1788837251.705758:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656512:12345-0@lo:501: Request processed in 172us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.705765:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837251.706141:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656512:0@lo:501: 00000100:00100000:1.0:1788837251.706162:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656640:0@lo:503: 00000100:00100000:1.0:1788837251.706190:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837251.706205:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42b98780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837251.706231:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708656640 00000100:00100000:0.0:1788837251.706235:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708656640 00000100:00100000:0.0:1788837251.706262:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788837251.706273:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656640:12345-0@lo:503: 00000100:00100000:0.0:1788837251.706413:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656640:12345-0@lo:503: Request processed in 141us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837251.706418:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837251.706502:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656640:0@lo:503: 00000040:00080000:1.0:1788837251.706700:0:7635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837251.706761:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656768:0@lo:502: 00000100:00100000:1.0:1788837251.706898:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837251.706928:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42b98780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837251.706982:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708656768 00000100:00100000:3.0:1788837251.706987:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708656768 00000100:00100000:3.0:1788837251.707017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837251.707024:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656768:12345-0@lo:502: 00000100:00100000:3.0:1788837251.707171:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656768:12345-0@lo:502: Request processed in 147us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.707177:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788837251.707393:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656768:0@lo:502: 00000040:00080000:1.0:1788837251.707622:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788837251.707670:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788837251.707702:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788837251.707760:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788837251.707916:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788837251.707952:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788837251.708039:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656896:0@lo:502: 00000100:00100000:1.0:1788837251.708096:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837251.708172:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42b98780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837251.708267:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708656896 00000100:00100000:2.0:1788837251.708272:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708656896 00000100:00100000:2.0:1788837251.708659:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837251.708670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656896:12345-0@lo:502: 00000100:00100000:2.0:1788837251.708843:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708656896:12345-0@lo:502: Request processed in 175us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837251.708851:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788837251.708930:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708656896:0@lo:502: 00000040:00080000:1.0:1788837251.709034:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788837251.709045:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788837251.709623:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788837251.709630:0:7643:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788837251.709636:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837251.709638:0:7643:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788837251.709642:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837251.709654:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9acb5d350000) 00000020:00000080:1.0:1788837251.709675:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788837251.709681:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788837251.709757:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb79181000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788837251.709774:0:7643:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788837251.709783:0:7643:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x843cbef8be30529f 00010000:00010000:1.0:1788837251.712694:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788837251.712966:0:7643:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788837251.717612:0:7643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788837251.718576:0:7643:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788837251.722804:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788837251.723503:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788837251.726576:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788837251.726589:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837251.726594:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837251.726596:0:7643:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788837251.726602:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837251.726611:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837251.726618:0:7643:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788837251.726621:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788837251.726623:0:7643:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788837251.726683:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837251.726686:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837251.726688:0:7643:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788837251.726691:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788837251.726787:0:7635:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788837251.726810:0:7635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788837251.726833:0:7635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.726845:0:7635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837251.726852:0:7635:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb79181000 from 1 10000000:01000000:0.0:1788837251.726855:0:7635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837251.726887:0:7635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.726896:0:7635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.726907:0:7635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837251.726926:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657024:0@lo:101: 00000100:00100000:0.0:1788837251.726995:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.727035:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837251.727043:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708657024 00000100:00100000:1.0:1788837251.727049:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708657024 00000100:00100000:1.0:1788837251.727102:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788837251.727111:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:7635:x1875731708657024:12345-0@lo:101: 00010000:00010000:1.0:1788837251.727124:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837251.727135:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3052a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.727157:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3052a6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.727166:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052a6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.727175:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577400, rc 0) 00000100:00100000:1.0:1788837251.727220:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657024:12345-0@lo:101: Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837251.727226:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788837251.727268:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657024:0@lo:101: 00010000:00010000:0.0:1788837251.727281:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.727300:0:7635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837251.727397:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657152:0@lo:501: 00000100:00100000:0.0:1788837251.727421:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.727447:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837251.731166:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708657152 00000100:00100000:1.0:1788837251.731180:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708657152 00000100:00100000:1.0:1788837251.731232:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788837251.731241:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657152:12345-0@lo:501: 00000100:00100000:1.0:1788837251.731549:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657152:12345-0@lo:501: Request processed in 309us (4126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837251.731564:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788837251.732239:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657152:0@lo:501: 00000100:00100000:0.0:1788837251.732288:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657280:0@lo:503: 00000100:00100000:0.0:1788837251.732360:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.732395:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837251.732600:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708657280 00000100:00100000:1.0:1788837251.732605:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708657280 00000100:00100000:1.0:1788837251.732647:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788837251.732655:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657280:12345-0@lo:503: 00000100:00100000:1.0:1788837251.732993:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657280:12345-0@lo:503: Request processed in 338us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837251.732999:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788837251.733333:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657280:0@lo:503: 00000040:00080000:0.0:1788837251.733603:0:7635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837251.733661:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657408:0@lo:502: 00000100:00100000:0.0:1788837251.733701:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.733733:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837251.733773:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708657408 00000100:00100000:1.0:1788837251.733778:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708657408 00000100:00100000:1.0:1788837251.733819:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788837251.733828:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657408:12345-0@lo:502: 00000100:00100000:1.0:1788837251.733990:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657408:12345-0@lo:502: Request processed in 164us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837251.733998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788837251.734142:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657408:0@lo:502: 00000040:00080000:0.0:1788837251.734405:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788837251.734450:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788837251.734472:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657536:0@lo:502: 00000100:00100000:0.0:1788837251.734505:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.734522:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837251.736642:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708657536 00000100:00100000:1.0:1788837251.736654:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708657536 00000100:00100000:1.0:1788837251.736704:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837251.736713:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657536:12345-0@lo:502: 00000100:00100000:1.0:1788837251.736936:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657536:12345-0@lo:502: Request processed in 223us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837251.736944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837251.737970:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657536:0@lo:502: 00000040:00080000:1.0:1788837251.738136:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788837251.738152:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788837251.741246:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837251.741265:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837251.741268:0:7647:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788837251.741276:0:7647:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb79181000 00000020:00000080:1.0:1788837251.741278:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788837251.741327:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837251.741332:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837251.741334:0:7647:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788837251.741338:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788837251.741955:0:7635:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788837251.742001:0:7635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837251.742024:0:7635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.742043:0:7635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837251.742094:0:7635:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788837251.742096:0:7635:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9acb79181000 10000000:01000000:0.0:1788837251.742099:0:7635:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9acb79181000 10000000:01000000:0.0:1788837251.742102:0:7635:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837251.742107:0:7635:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb79181000 from 1 10000000:01000000:0.0:1788837251.742109:0:7635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837251.742143:0:7635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.742151:0:7635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837251.742161:0:7635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837251.742183:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79053480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657664:0@lo:101: 00000100:00100000:0.0:1788837251.742245:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.742282:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837251.742447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708657664 00000100:00100000:1.0:1788837251.742454:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708657664 00000100:00100000:1.0:1788837251.742485:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788837251.742493:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708657664:12345-0@lo:101: 00010000:00010000:1.0:1788837251.742504:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837251.742516:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3052b4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.742537:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3052b4 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.742547:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052b4 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.742556:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576000, rc 0) 00000100:00100000:1.0:1788837251.742595:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708657664:12345-0@lo:101: Request processed in 102us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837251.742601:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788837251.742643:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79053480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657664:0@lo:101: 00010000:00010000:1.0:1788837251.742656:0:7635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.742674:0:7635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837251.742751:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657792:0@lo:501: 00000100:00100000:1.0:1788837251.742774:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837251.742790:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79636a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837251.742802:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708657792 00000100:00100000:1.0:1788837251.742805:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708657792 00000100:00100000:1.0:1788837251.742835:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837251.742841:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708657792:12345-0@lo:501: 00000100:00100000:1.0:1788837251.743028:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708657792:12345-0@lo:501: Request processed in 187us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837251.743034:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837251.743075:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657792:0@lo:501: 00000100:00100000:1.0:1788837251.743095:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657920:0@lo:503: 00000100:00100000:1.0:1788837251.743127:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837251.743138:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79636a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837251.743149:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708657920 00000100:00100000:1.0:1788837251.743151:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708657920 00000100:00100000:1.0:1788837251.743168:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837251.743173:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708657920:12345-0@lo:503: 00000100:00100000:1.0:1788837251.743293:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708657920:12345-0@lo:503: Request processed in 118us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837251.743299:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837251.743356:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708657920:0@lo:503: 00000040:00080000:1.0:1788837251.743580:0:7635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837251.743636:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708658048:0@lo:502: 00000100:00100000:1.0:1788837251.743669:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837251.743688:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79636a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837251.743700:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708658048 00000100:00100000:1.0:1788837251.743703:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708658048 00000100:00100000:1.0:1788837251.743724:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788837251.743730:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708658048:12345-0@lo:502: 00000100:00100000:1.0:1788837251.743866:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708658048:12345-0@lo:502: Request processed in 135us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837251.743872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788837251.743911:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708658048:0@lo:502: 00000040:00080000:1.0:1788837251.744146:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788837251.744193:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788837251.744227:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788837251.744273:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788837251.744332:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788837251.744394:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788837251.744428:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788837251.744461:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788837251.744503:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788837251.744536:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788837251.744585:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788837251.744635:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788837251.744670:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788837251.744703:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788837251.744750:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788837251.744802:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788837251.744839:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788837251.744898:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788837251.744934:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788837251.744970:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788837251.745016:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788837251.750393:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788837251.750509:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788837251.750589:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788837251.750628:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788837251.750667:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788837251.750755:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788837251.750796:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788837251.751161:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788837251.751233:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788837251.751274:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788837251.751356:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788837251.751397:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788837251.751456:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788837251.751496:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788837251.751551:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788837251.751592:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788837251.751638:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708658176:0@lo:502: 00000100:00100000:1.0:1788837251.751712:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837251.751753:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79636a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837251.752018:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708658176 00000100:00100000:2.0:1788837251.752026:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708658176 00000100:00100000:2.0:1788837251.752083:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788837251.752092:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708658176:12345-0@lo:502: 00000100:00100000:2.0:1788837251.752331:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708658176:12345-0@lo:502: Request processed in 238us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837251.752338:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788837251.753521:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708658176:0@lo:502: 00000040:00080000:3.0:1788837251.753647:0:7635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788837251.753660:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788837251.754285:0:7648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788837251.754299:0:7648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9acb58734d28) 00000020:00000080:3.0:1788837251.754345:0:7648:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788837251.754420:0:7648:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb79181000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788837251.754424:0:7648:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9acb79181000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788837251.754426:0:7648:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb79181000 3 00010000:00080000:3.0:1788837251.754452:0:7648:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb7b458000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1788837251.762399:0:7648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788837251.762579:0:7648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788837251.762613:0:7648:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788837251.762632:0:7648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x843cbef8be3052c9 00000100:00080000:3.0:1788837251.762642:0:7648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837251.762647:0:7648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9acb7b458000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1788837251.762676:0:7648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb74c10380 x1875731708658304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837251.762694:0:7648:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788837251.762932:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1875731708658304:0@lo:38: 00000100:00100000:0.0:1788837251.762993:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.763045:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708658304 00000100:00100000:0.0:1788837251.763062:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708658304 00000100:00100000:0.0:1788837251.763089:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837251.763095:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875731708658304:12345-0@lo:38: 00010000:00080000:0.0:1788837251.763114:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1788837251.763149:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x843cbef8be3052d0 00000004:00100000:0.0:1788837251.763160:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788837251.763193:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9acb79138800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837251.763234:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875731708658304:12345-0@lo:38: Request processed in 138us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837251.763240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788837251.763272:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb74c10380 x1875731708658304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837251.763282:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837251.763288:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788837251.763293:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788837251.763296:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788837251.763298:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb7b458000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788837251.763324:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1875731708658304:0@lo:38: 00000040:00080000:1.0:1788837251.767337:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788837251.767478:0:7635:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788837251.767505:0:7635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788837251.767528:0:7635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.767540:0:7635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788837251.767598:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788837251.767600:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837251.767602:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837251.767603:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837251.767604:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837251.767605:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837251.767606:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837251.767608:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788837251.767609:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788837251.767611:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837251.767612:0:7635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788837251.767615:0:7635:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788837251.767618:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788837251.767619:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837251.767620:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837251.767621:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837251.767623:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837251.767630:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837251.767631:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837251.767632:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788837251.767632:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788837251.767633:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837251.767634:0:7635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788837251.767659:0:7635:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788837251.767676:0:7635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c10e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708658432:0@lo:253: 00000100:00100000:3.0:1788837251.767738:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.767777:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837251.770074:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708658432 00000100:00100000:3.0:1788837251.770088:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708658432 00000100:00100000:3.0:1788837251.770135:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788837251.770143:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:7635:x1875731708658432:12345-0@lo:253: 20000000:01000000:3.0:1788837251.770182:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788837251.770195:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788837251.771159:0:7649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79050a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7649:1875731708658560:0@lo:901: 00000100:00100000:0.0:1788837251.771220:0:7649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837251.771474:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708658560 00000100:00100000:0.0:1788837251.771479:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708658560 00000100:00080000:2.0:1788837251.771513:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837251.771595:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837251.771605:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7649:x1875731708658560:12345-0@lo:901: 00000100:00100000:0.0:1788837251.773641:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7649:x1875731708658560:12345-0@lo:901: Request processed in 2031us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837251.773653:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837251.775854:0:7649:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d540 going to sleep for 11 seconds 00010000:00080000:0.0:1788837251.775896:0:7649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb79050a80 x1875731708658560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788837267 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837251.775930:0:7649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79050a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7649:1875731708658560:0@lo:901: 20000000:01000000:3.0:1788837251.812296:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788837251.812370:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788837251.814293:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788837251.814315:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788837251.814338:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.814356:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305221 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.814365:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.814406:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305221 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837251.814419:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305221 expref: 14 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837251.814432:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875731708658688:0@lo:104: 00000100:00100000:2.0:1788837251.814492:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837251.814546:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788837251.814635:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708658688 00000100:00100000:3.0:1788837251.814642:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708658688 00000100:00100000:3.0:1788837251.814692:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837251.814701:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5860:x1875731708658688:12345-0@lo:104: 00010000:00010000:3.0:1788837251.814712:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.814761:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837251.814766:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:5860:x1875731708658688:12345-0@lo:104: Request processed in 67us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.814772:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788837251.814791:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837251.814797:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.814825:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb41485000 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837251.814829:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.814837:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837251.814844:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837251.814849:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837251.814873:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.814879:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837251.814894:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.814901:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb41485000/0x843cbef8be305221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305228 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.814918:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837251.814920:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837251.814922:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837251.814934:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708658816:0@lo:103: 00000100:00100000:3.0:1788837251.814980:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.815010:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708658816 00000100:00100000:3.0:1788837251.815013:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708658816 00010000:00010000:3.0:1788837251.815027:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305221 expref: 15 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837251.815066:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837251.815073:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:3314:x1875731708658816:12345-0@lo:103: 00010000:00010000:3.0:1788837251.815082:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837251.815088:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305221 expref: 15 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815097:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305221 expref: 15 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815111:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815118:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837251.815130:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001649502s 00010000:00010000:3.0:1788837251.815134:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815141:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815147:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815153:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815157:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167b400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837251.815161:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815173:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815180:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815189:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837251.815215:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:3314:x1875731708658816:12345-0@lo:103: Request processed in 144us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.815221:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837251.815289:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708658816:0@lo:103: 00010000:00010000:3.0:1788837251.815354:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb41485e00/0x843cbef8be305228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305221 expref: 14 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837251.815364:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875731708658688:0@lo:104: 00010000:00010000:3.0:1788837251.815375:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815384:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815390:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837251.815396:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb4167b400/0x843cbef8be3052d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837251.815645:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837251.824114:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:7635:x1875731708658432:12345-0@lo:253: Request processed in 53962us (56365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.824136:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788837251.824225:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c10e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30a8965a-c42f-4c1b-a594-94749f11bd0b:7635:1875731708658432:0@lo:253: 10000000:01000000:1.0:1788837251.824240:0:7635:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788837251.824243:0:7635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788837251.824245:0:7635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788837251.824247:0:7635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837251.824248:0:7635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837251.824250:0:7635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837251.824256:0:7635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837251.824258:0:7635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837251.824260:0:7635:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837251.824261:0:7635:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837251.824262:0:7635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837251.824264:0:7635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788837251.824279:0:7635:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788837251.830096:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788837251.830268:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788837251.830517:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788837251.830681:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788837251.831125:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788837251.831458:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788837251.832747:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788837251.948329:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708658944:0@lo:13: 00000100:00100000:3.0:1788837251.948399:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837251.948485:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708658944 00000100:00100000:3.0:1788837251.948493:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708658944 00000100:00100000:3.0:1788837251.948533:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837251.948541:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708658944:12345-0@lo:13: 00002000:00000024:3.0:1788837251.948572:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837251.948615:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708658944:12345-0@lo:13: Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837251.948622:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788837251.948657:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb58744000 x1875731708658944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837251.948675:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708658944:0@lo:13: 00002000:00080000:1.0:1788837252.029922:0:7635:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788837252.029929:0:7635:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788837252.030030:0:7635:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788837252.030090:0:7635:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788837252.030102:0:7635:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788837252.030121:0:7635:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788837252.841159:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837253.862291:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837254.885570:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837255.909500:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837256.933511:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837257.061587:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708659072:0@lo:13: 00000100:00100000:3.0:1788837257.061659:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837257.061698:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708659200:0@lo:400: 00000100:00100000:3.0:1788837257.061717:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708659584:0@lo:400: 00000100:00100000:0.0:1788837257.061730:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837257.061745:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837257.061754:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837257.061759:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837257.061759:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708659328:0@lo:400: 00000100:00100000:3.0:1788837257.061764:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708659456:0@lo:400: 00000100:00100000:0.0:1788837257.061779:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837257.061796:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708659072 00000100:00100000:3.0:1788837257.061803:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708659072 00000100:00100000:0.0:1788837257.061803:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708659200 00000100:00100000:0.0:1788837257.061805:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708659200 00000100:00100000:3.0:1788837257.061846:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837257.061855:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708659072:12345-0@lo:13: 00002000:00000024:3.0:1788837257.061901:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837257.061935:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708659072:12345-0@lo:13: Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837257.061942:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837257.061967:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708659584 00000100:00100000:3.0:1788837257.061970:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708659584 00000100:00100000:3.0:1788837257.061994:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708659328 00000100:00100000:3.0:1788837257.061997:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708659328 00000100:00100000:3.0:1788837257.062013:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837257.062031:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708659584:12345-0@lo:400: 00000100:00100000:3.0:1788837257.062063:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708659584:12345-0@lo:400: Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837257.062069:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837257.062080:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837257.062087:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708659328:12345-0@lo:400: 00000100:00100000:3.0:1788837257.062129:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708659328:12345-0@lo:400: Request processed in 43us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837257.062135:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788837257.062154:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837257.062158:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837257.062189:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79053800 x1875731708659328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837257.062202:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708659328:0@lo:400: 00000100:00100000:3.0:1788837257.062222:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788837257.062240:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79050e00 x1875731708659584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837257.062248:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708659584:0@lo:400: 00010000:00080000:3.0:1788837257.062264:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb58746300 x1875731708659072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837257.062275:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708659072:0@lo:13: 00000100:00100000:3.0:1788837257.062292:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708659456 00000100:00100000:3.0:1788837257.062294:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708659456 00000100:00100000:3.0:1788837257.062331:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788837257.062337:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708659456:12345-0@lo:400: 00000100:00100000:3.0:1788837257.062364:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708659456:12345-0@lo:400: Request processed in 28us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837257.062369:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788837257.062381:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788837257.062393:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79050380 x1875731708659456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837257.062401:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708659456:0@lo:400: 00000100:00100000:0.0:1788837257.062542:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788837257.062550:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:3313:x1875731708659200:12345-0@lo:400: 00000100:00100000:0.0:1788837257.062584:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:3313:x1875731708659200:12345-0@lo:400: Request processed in 35us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837257.062590:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788837257.063953:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708659200:0@lo:400: 00010000:00010000:0.0:1788837257.958525:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788837258.295373:0:7991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788837258.983719:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837260.005734:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788837260.136003:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788837260.136010:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb45cdf000 from 30 10000000:01000000:2.0:1788837260.136016:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837260.136057:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.136069:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.136079:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837260.136128:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708659712:0@lo:101: 00000100:00100000:2.0:1788837260.136195:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.136249:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.136928:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708659712 00000100:00100000:0.0:1788837260.136937:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708659712 00000100:00100000:0.0:1788837260.137003:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788837260.137014:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708659712:12345-0@lo:101: 00010000:00010000:0.0:1788837260.137026:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837260.137040:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3052de expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837260.137065:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3052de expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837260.137085:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052de expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837260.137094:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030a00, rc 0) 00000100:00100000:0.0:1788837260.137153:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708659712:12345-0@lo:101: Request processed in 141us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.137160:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788837260.137503:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708659712:0@lo:101: 00010000:00010000:2.0:1788837260.137521:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.137554:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837260.137612:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708659840:0@lo:501: 00000100:00100000:2.0:1788837260.137643:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.137676:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.137773:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708659840 00000100:00100000:0.0:1788837260.137778:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708659840 00000100:00100000:0.0:1788837260.137813:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788837260.137820:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708659840:12345-0@lo:501: 00000100:00100000:0.0:1788837260.138616:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708659840:12345-0@lo:501: Request processed in 793us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.138624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837260.138822:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708659840:0@lo:501: 00000100:00100000:2.0:1788837260.138858:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708659968:0@lo:503: 00000100:00100000:2.0:1788837260.138900:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.138930:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837260.138977:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708659968 00000100:00100000:3.0:1788837260.138982:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708659968 00000100:00100000:3.0:1788837260.139026:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788837260.139039:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708659968:12345-0@lo:503: 00000100:00100000:3.0:1788837260.139763:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708659968:12345-0@lo:503: Request processed in 728us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.139771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788837260.139935:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708659968:0@lo:503: 00000100:00100000:1.0:1788837260.141014:0:8096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8096:1875731708660096:0@lo:502: 00000100:00100000:1.0:1788837260.141073:0:8096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.141114:0:8096:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7ae32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.141208:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708660096 00000100:00100000:0.0:1788837260.141214:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708660096 00000100:00100000:0.0:1788837260.141254:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788837260.141263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:8096:x1875731708660096:12345-0@lo:502: 00000100:00100000:0.0:1788837260.141766:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:8096:x1875731708660096:12345-0@lo:502: Request processed in 503us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.141774:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788837260.141852:0:8096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8096:1875731708660096:0@lo:502: 00000100:00100000:1.0:1788837260.141895:0:8096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8096:1875731708660224:0@lo:502: 00000100:00100000:1.0:1788837260.141930:0:8096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.141963:0:8096:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7ae32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.142015:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708660224 00000100:00100000:0.0:1788837260.142020:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708660224 00000100:00100000:0.0:1788837260.142052:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788837260.142059:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:8096:x1875731708660224:12345-0@lo:502: 00000100:00100000:0.0:1788837260.142281:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:8096:x1875731708660224:12345-0@lo:502: Request processed in 222us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.142294:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788837260.142401:0:8096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8096:1875731708660224:0@lo:502: 00000040:00080000:1.0:1788837260.142427:0:8096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788837260.142611:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788837260.142630:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837260.142640:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.142650:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837260.142671:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788837260.142673:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788837260.142676:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837260.142699:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.142707:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.142717:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837260.142729:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708660352:0@lo:101: 00000100:00100000:2.0:1788837260.142758:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.142785:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.142850:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708660352 00000100:00100000:0.0:1788837260.142855:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708660352 00000100:00100000:0.0:1788837260.142885:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788837260.142892:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708660352:12345-0@lo:101: 00010000:00010000:0.0:1788837260.142901:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837260.142913:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3052ec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837260.142932:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3052ec expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837260.142942:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052ec expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837260.142950:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030400, rc 0) 00000100:00100000:0.0:1788837260.143034:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708660352:12345-0@lo:101: Request processed in 142us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.143041:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788837260.143517:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708660352:0@lo:101: 00010000:00010000:2.0:1788837260.143532:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.143541:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837260.143586:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708660480:0@lo:501: 00000100:00100000:2.0:1788837260.143613:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.143680:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.143716:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708660480 00000100:00100000:0.0:1788837260.143721:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708660480 00000100:00100000:0.0:1788837260.143785:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788837260.143793:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708660480:12345-0@lo:501: 00000100:00100000:0.0:1788837260.144055:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708660480:12345-0@lo:501: Request processed in 262us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.144063:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788837260.144196:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708660480:0@lo:501: 00000100:00100000:2.0:1788837260.144224:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708660608:0@lo:503: 00000100:00100000:2.0:1788837260.144265:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.144294:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837260.144390:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708660608 00000100:00100000:1.0:1788837260.144395:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708660608 00000100:00100000:1.0:1788837260.144427:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788837260.144435:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708660608:12345-0@lo:503: 00000100:00100000:1.0:1788837260.145177:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708660608:12345-0@lo:503: Request processed in 740us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837260.145184:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788837260.145345:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708660608:0@lo:503: 00000100:00100000:1.0:1788837260.145837:0:8097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8097:1875731708660736:0@lo:502: 00000100:00100000:1.0:1788837260.145879:0:8097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.145951:0:8097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb501123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.146051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708660736 00000100:00100000:0.0:1788837260.146057:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708660736 00000100:00100000:0.0:1788837260.146115:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788837260.146123:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:8097:x1875731708660736:12345-0@lo:502: 00000100:00100000:0.0:1788837260.146354:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:8097:x1875731708660736:12345-0@lo:502: Request processed in 231us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.146361:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788837260.146631:0:8097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8097:1875731708660736:0@lo:502: 00000020:01000000:2.0:1788837260.146661:0:8097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837260.146670:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837260.146672:0:8097:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837260.146677:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837260.146679:0:8097:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788837260.146696:0:8097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8097:1875731708660864:0@lo:502: 00000100:00100000:2.0:1788837260.146734:0:8097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.146744:0:8097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.146800:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708660864 00000100:00100000:0.0:1788837260.146804:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708660864 00000100:00100000:0.0:1788837260.146822:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788837260.146827:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:8097:x1875731708660864:12345-0@lo:502: 00000100:00100000:0.0:1788837260.148851:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:8097:x1875731708660864:12345-0@lo:502: Request processed in 2016us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.148862:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788837260.149445:0:8097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8097:1875731708660864:0@lo:502: 00000020:01000000:2.0:1788837260.149476:0:8097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837260.149482:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837260.149484:0:8097:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837260.149488:0:8097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788837260.149620:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788837260.149640:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788837260.149651:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837260.149661:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837260.149670:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788837260.149672:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb6a76b800 from 30 10000000:01000000:1.0:1788837260.149675:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837260.149699:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837260.149706:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837260.149715:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837260.149739:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708660992:0@lo:101: 00000100:00100000:1.0:1788837260.149776:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.149813:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50112600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837260.149906:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708660992 00000100:00100000:2.0:1788837260.149912:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708660992 00000100:00100000:2.0:1788837260.149948:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788837260.149956:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708660992:12345-0@lo:101: 00010000:00010000:2.0:1788837260.149966:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837260.149977:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3052fa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.150008:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3052fa expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.150030:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052fa expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.150039:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167b800, rc 0) 00000100:00100000:2.0:1788837260.150069:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708660992:12345-0@lo:101: Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837260.150075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788837260.150130:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708660992:0@lo:101: 00010000:00010000:1.0:1788837260.150141:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837260.150150:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837260.150186:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661120:0@lo:501: 00000100:00100000:1.0:1788837260.150211:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.150230:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50112600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837260.150242:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708661120 00000100:00100000:1.0:1788837260.150246:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708661120 00000100:00100000:1.0:1788837260.150262:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837260.150268:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708661120:12345-0@lo:501: 00000100:00100000:1.0:1788837260.150506:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708661120:12345-0@lo:501: Request processed in 237us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837260.150513:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837260.150540:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661120:0@lo:501: 00000100:00100000:1.0:1788837260.150562:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661248:0@lo:503: 00000100:00100000:1.0:1788837260.150595:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.150613:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50112600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837260.150624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708661248 00000100:00100000:1.0:1788837260.150633:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708661248 00000100:00100000:1.0:1788837260.150650:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788837260.150655:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708661248:12345-0@lo:503: 00000100:00100000:1.0:1788837260.150773:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708661248:12345-0@lo:503: Request processed in 117us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837260.150779:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788837260.150814:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661248:0@lo:503: 00000100:00100000:1.0:1788837260.155890:0:8098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8098:1875731708661376:0@lo:502: 00000100:00100000:1.0:1788837260.155979:0:8098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.156031:0:8098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb45cfe840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.156126:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708661376 00000100:00100000:0.0:1788837260.156134:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708661376 00000100:00100000:0.0:1788837260.156182:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788837260.156191:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:8098:x1875731708661376:12345-0@lo:502: 00000100:00100000:0.0:1788837260.156689:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:8098:x1875731708661376:12345-0@lo:502: Request processed in 497us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.156698:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788837260.156784:0:8098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8098:1875731708661376:0@lo:502: 00000100:00100000:1.0:1788837260.156830:0:8098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8098:1875731708661504:0@lo:502: 00000100:00100000:1.0:1788837260.156863:0:8098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.156890:0:8098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb45cfe840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837260.156928:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708661504 00000100:00100000:2.0:1788837260.156933:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708661504 00000100:00100000:2.0:1788837260.156968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788837260.156976:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:8098:x1875731708661504:12345-0@lo:502: 00000100:00100000:2.0:1788837260.157144:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:8098:x1875731708661504:12345-0@lo:502: Request processed in 169us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837260.157150:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788837260.157417:0:8098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8098:1875731708661504:0@lo:502: 00000040:00080000:1.0:1788837260.157436:0:8098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788837260.157641:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788837260.157665:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788837260.157674:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837260.157685:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837260.157695:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788837260.157698:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9acb6a76b800 from 5 10000000:01000000:3.0:1788837260.157700:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788837260.157725:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837260.157733:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837260.157743:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837260.157756:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661632:0@lo:101: 00000100:00100000:3.0:1788837260.157789:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837260.157821:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb75496c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.158697:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708661632 00000100:00100000:0.0:1788837260.158706:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708661632 00000100:00100000:0.0:1788837260.158751:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837260.158759:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708661632:12345-0@lo:101: 00010000:00010000:0.0:1788837260.158770:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837260.158785:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb40031c00/0x843cbef8be30530f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305308 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837260.158808:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb40031c00/0x843cbef8be30530f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305308 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837260.158829:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb40031c00/0x843cbef8be30530f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305308 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837260.158838:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031c00, rc 0) 00000100:00100000:0.0:1788837260.158894:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708661632:12345-0@lo:101: Request processed in 135us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.158900:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788837260.158978:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661632:0@lo:101: 00010000:00010000:2.0:1788837260.158993:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.159011:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837260.159062:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661760:0@lo:256: 00000100:00100000:2.0:1788837260.159105:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.159131:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.159175:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708661760 00000100:00100000:0.0:1788837260.159180:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708661760 00000100:00100000:0.0:1788837260.159197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788837260.159204:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708661760:12345-0@lo:256: 20000000:01000000:0.0:1788837260.159216:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788837260.159231:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788837260.159234:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788837260.159626:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708661760:12345-0@lo:256: Request processed in 421us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.159633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788837260.159719:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661760:0@lo:256: 10000000:01000000:2.0:1788837260.159758:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788837260.159769:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.159778:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837260.159786:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788837260.159788:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788837260.159791:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837260.159811:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.159818:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.159826:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837260.159838:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661888:0@lo:101: 00000100:00100000:2.0:1788837260.159864:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.159892:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837260.160036:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708661888 00000100:00100000:1.0:1788837260.160041:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708661888 00000100:00100000:1.0:1788837260.160073:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788837260.160177:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708661888:12345-0@lo:101: 00010000:00010000:1.0:1788837260.160187:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837260.160199:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837260.160218:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305316 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837260.160239:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305316 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837260.160248:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577200, rc 0) 00000100:00100000:1.0:1788837260.160418:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708661888:12345-0@lo:101: Request processed in 337us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837260.160424:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837260.160752:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708661888:0@lo:101: 00010000:00010000:2.0:1788837260.160768:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.160777:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837260.160830:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708662016:0@lo:501: 00000100:00100000:2.0:1788837260.160870:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.160939:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.160972:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708662016 00000100:00100000:0.0:1788837260.160977:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708662016 00000100:00100000:0.0:1788837260.161053:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788837260.161061:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708662016:12345-0@lo:501: 00000100:00100000:0.0:1788837260.161351:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708662016:12345-0@lo:501: Request processed in 290us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.161358:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788837260.161434:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708662016:0@lo:501: 00000100:00100000:2.0:1788837260.161463:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708662144:0@lo:503: 00000100:00100000:2.0:1788837260.161501:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.161878:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12000 going to sleep for 11 seconds 00000100:00100000:3.0:1788837260.161962:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708662144 00000100:00100000:3.0:1788837260.161968:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708662144 00000100:00100000:3.0:1788837260.161993:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788837260.162011:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708662144:12345-0@lo:503: 00000100:00100000:3.0:1788837260.162577:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708662144:12345-0@lo:503: Request processed in 565us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.162586:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837260.162658:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708662144:0@lo:503: 00000100:00100000:2.0:1788837260.163054:0:8099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8099:1875731708662272:0@lo:502: 00000100:00100000:2.0:1788837260.163090:0:8099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.163119:0:8099:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837260.163158:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708662272 00000100:00100000:3.0:1788837260.163167:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708662272 00000100:00100000:3.0:1788837260.163196:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788837260.163203:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8099:x1875731708662272:12345-0@lo:502: 00000100:00100000:3.0:1788837260.163640:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8099:x1875731708662272:12345-0@lo:502: Request processed in 436us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.163647:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788837260.163722:0:8099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8099:1875731708662272:0@lo:502: 00000020:01000000:0.0:1788837260.163747:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788837260.163759:0:8099:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788837260.163765:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837260.163767:0:8099:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788837260.163773:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788837260.163776:0:8099:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:0.0:1788837260.163795:0:8099:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788837260.163797:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837260.163811:0:8099:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9acb7ade4d28) 00000020:00000080:0.0:1788837260.163830:0:8099:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788837260.163837:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788837260.163898:0:8099:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788837260.163903:0:8099:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788837260.163909:0:8099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be30532b 00010000:00080000:0.0:1788837260.163930:0:8099:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb7913f800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1788837260.164136:0:8099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788837260.164456:0:8099:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788837260.164466:0:8099:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788837260.164972:0:8099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837260.165209:0:8099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837260.165260:0:8099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788837260.165349:0:8099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788837260.167259:0:8100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837260.167266:0:8100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788837260.170406:0:8099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788837260.170422:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788837260.170455:0:8099:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788837260.170490:0:8099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be305332 00000100:00080000:2.0:1788837260.170506:0:8099:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837260.170512:0:8099:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9acb7913f800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1788837260.170621:0:8099:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb58744000 x1875731708662400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837260.170647:0:8099:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788837260.170711:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837260.170715:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837260.170717:0:8099:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788837260.170720:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837260.170724:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837260.170726:0:8099:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837260.170735:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837260.170737:0:8099:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788837260.170767:0:8099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8099:1875731708662528:0@lo:502: 00000100:00100000:2.0:1788837260.170847:0:8099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.170877:0:8099:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837260.170988:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708662784:0@lo:400: 00000100:00100000:3.0:1788837260.171029:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837260.171050:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837260.171055:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708662656:0@lo:400: 00000100:00100000:3.0:1788837260.171076:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837260.171098:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708662912:0@lo:400: 00000100:00100000:3.0:1788837260.171122:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837260.171140:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837260.171145:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708663040:0@lo:400: 00000100:00100000:3.0:1788837260.171165:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837260.171195:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708662784 00000100:00100000:3.0:1788837260.171202:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708662784 00000100:00100000:3.0:1788837260.171242:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708662656 00000100:00100000:3.0:1788837260.171245:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708662656 00000100:00100000:3.0:1788837260.171257:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708663040 00000100:00100000:3.0:1788837260.171259:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708663040 00000100:00100000:3.0:1788837260.171275:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837260.171283:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708662784:12345-0@lo:400: 00000100:00100000:3.0:1788837260.171355:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708662784:12345-0@lo:400: Request processed in 72us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.171361:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837260.171376:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837260.171388:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708662656:12345-0@lo:400: 00000100:00100000:3.0:1788837260.171414:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708662656:12345-0@lo:400: Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.171419:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837260.171432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837260.171439:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708663040:12345-0@lo:400: 00000100:00100000:3.0:1788837260.171467:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708663040:12345-0@lo:400: Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.171472:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837260.171492:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708662912 00000100:00100000:3.0:1788837260.171495:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708662912 00000100:00100000:3.0:1788837260.171522:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837260.171529:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708662912:12345-0@lo:400: 00000100:00100000:3.0:1788837260.171558:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708662912:12345-0@lo:400: Request processed in 30us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.171564:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788837260.171581:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837260.171585:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788837260.171611:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74c11500 x1875731708663040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837260.171626:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708663040:0@lo:400: 00010000:00080000:3.0:1788837260.171636:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74c11c00 x1875731708662912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837260.171644:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708662912:0@lo:400: 00010000:00080000:3.0:1788837260.171670:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74c10000 x1875731708662656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837260.171691:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708662656:0@lo:400: 00010000:00080000:3.0:1788837260.171703:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74c12300 x1875731708662784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837260.171711:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708662784:0@lo:400: 00000100:00100000:0.0:1788837260.171793:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708662400:0@lo:8: 00000100:00100000:0.0:1788837260.171827:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837260.171874:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708662528 00000100:00100000:0.0:1788837260.171878:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708662528 00000100:00100000:0.0:1788837260.171903:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788837260.171910:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8099:x1875731708662528:12345-0@lo:502: 00000100:00100000:0.0:1788837260.172142:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8099:x1875731708662528:12345-0@lo:502: Request processed in 232us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837260.172150:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788837260.172238:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708662400 00000100:00100000:3.0:1788837260.172243:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708662400 00000100:00100000:3.0:1788837260.172268:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837260.172273:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1875731708662400:12345-0@lo:8: 00010000:00080000:3.0:1788837260.172293:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1788837260.172337:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be305339 00002000:00100000:3.0:1788837260.172350:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9acb79134800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788837260.172354:0:6700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788837260.172358:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788837260.172458:0:6700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788837260.172600:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788837260.172621:0:6700:0:(import.c:65:import_set_state_nolock()) ffff9acb79135000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837260.172660:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875731708662400:12345-0@lo:8: Request processed in 385us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.172667:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837260.172779:0:8099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8099:1875731708662528:0@lo:502: 00000020:01000000:2.0:1788837260.172811:0:8099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837260.172817:0:8099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837260.172820:0:8099:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837260.172823:0:8099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:0.0:1788837260.176107:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb58744000 x1875731708662400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837260.176122:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837260.176131:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788837260.176140:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788837260.176146:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788837260.176149:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb7913f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788837260.176164:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788837260.176171:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708662400:0@lo:8: 00000020:01000000:3.0:1788837260.176451:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788837260.176479:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000004:00080000:2.0:1788837260.176575:0:8100:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:3.0:1788837260.176620:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837260.176632:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837260.176656:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788837260.176659:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9acb587319b8 from 1 10000000:01000000:3.0:1788837260.176662:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000004:00080000:2.0:1788837260.176679:0:8100:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 214027373523ns, next at 0ns, rc = 0 00010000:00010000:3.0:1788837260.176699:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837260.176708:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837260.176717:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837260.176735:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708663168:0@lo:101: 00000100:00100000:3.0:1788837260.176790:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837260.176834:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb75496c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837260.179499:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708663168 00000100:00100000:2.0:1788837260.179515:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708663168 00000100:00100000:2.0:1788837260.179566:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788837260.179576:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708663168:12345-0@lo:101: 00010000:00010000:2.0:1788837260.179592:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837260.179610:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305340 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.179636:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305340 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.179647:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305340 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837260.179656:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167b400, rc 0) 00000100:00100000:2.0:1788837260.179740:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708663168:12345-0@lo:101: Request processed in 165us (2949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837260.179758:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788837260.179797:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708663168:0@lo:101: 00010000:00010000:3.0:1788837260.179818:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837260.179828:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837260.179889:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708663296:0@lo:501: 00000100:00100000:3.0:1788837260.179929:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837260.179968:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb75496c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.180119:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708663296 00000100:00100000:0.0:1788837260.180124:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708663296 00000100:00100000:0.0:1788837260.180161:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788837260.180169:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708663296:12345-0@lo:501: 00000100:00100000:0.0:1788837260.180393:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708663296:12345-0@lo:501: Request processed in 224us (463us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837260.180401:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788837260.180424:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708663296:0@lo:501: 10000000:01000000:3.0:1788837260.180451:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788837260.180464:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837260.180473:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837260.220785:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788837260.220931:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708663424:0@lo:13: 00000100:00100000:2.0:1788837260.221013:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837260.221099:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708663424 00000100:00100000:3.0:1788837260.221106:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708663424 00000100:00100000:3.0:1788837260.221166:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837260.221174:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708663424:12345-0@lo:13: 00002000:00000024:3.0:1788837260.221202:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:1.0:1788837260.221335:0:8101:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788837260.221356:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875731708663552:0@lo:7: 00000100:00100000:1.0:1788837260.221386:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.221404:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb45cfee40 going to sleep for 11 seconds 00000100:00080000:0.0:1788837260.221471:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837260.221636:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708663424:12345-0@lo:13: Request processed in 461us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.221643:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837260.221669:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708663552 00000100:00100000:3.0:1788837260.221673:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708663552 00000100:00100000:3.0:1788837260.221733:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788837260.221740:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8101:x1875731708663552:12345-0@lo:7: 00010000:00080000:2.0:1788837260.223025:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb457ab800 x1875731708663424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837260.223048:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708663424:0@lo:13: 00002000:00080000:3.0:1788837260.227499:0:6701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788837260.227509:0:6701:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788837260.227650:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8101:x1875731708663552:12345-0@lo:7: Request processed in 5907us (6259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.227661:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788837260.227737:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb457a9180 x1875731708663552/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837276 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837260.227752:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875731708663552:0@lo:7: 00000004:00080000:1.0:1788837260.227767:0:8101:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788837260.227802:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875731708663680:0@lo:5: 00000100:00100000:1.0:1788837260.227836:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.227918:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb45cfee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837260.228012:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708663680 00000100:00100000:0.0:1788837260.228018:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708663680 00000100:00100000:0.0:1788837260.228095:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837260.228106:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8101:x1875731708663680:12345-0@lo:5: 00002000:00080000:0.0:1788837260.228129:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788837260.228132:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788837260.228465:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8101:x1875731708663680:12345-0@lo:5: Request processed in 361us (627us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788837260.228472:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788837260.228535:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb457a9180 x1875731708663680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837276 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837260.228548:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875731708663680:0@lo:5: 00000004:00080000:1.0:1788837260.228556:0:8101:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788837260.228581:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875731708663808:0@lo:700: 00000100:00100000:1.0:1788837260.228607:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837260.228641:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb45cfee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837260.228713:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708663808 00000100:00100000:2.0:1788837260.228718:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708663808 00000100:00100000:2.0:1788837260.228753:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837260.228761:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8101:x1875731708663808:12345-0@lo:700: 00000100:00100000:2.0:1788837260.228792:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6707:1875731708663936:0@lo:700: 00000100:00100000:2.0:1788837260.228834:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837260.228855:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837260.228872:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708663936 00000100:00100000:2.0:1788837260.228875:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708663936 00000100:00100000:2.0:1788837260.228914:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837260.228922:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6707:x1875731708663936:12345-0@lo:700: 40000000:02000000:3.0:1788837260.256563:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788837260.265544:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6707:x1875731708663936:12345-0@lo:700: Request processed in 36616us (36702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837260.265557:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788837260.266079:0:6707:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb58744e00 x1875731708663936/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788837276 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837260.266105:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6707:1875731708663936:0@lo:700: 40000000:02000000:0.0:1788837260.266118:0:6707:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788837260.332690:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788837260.332708:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788837260.332978:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8101:x1875731708663808:12345-0@lo:700: Request processed in 104214us (104366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837260.332990:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788837260.333337:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb457a8380 x1875731708663808/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788837276 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837260.333350:0:8101:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788837260.333367:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875731708663808:0@lo:700: 00000004:02000040:0.0:1788837260.354760:0:8101:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788837260.358016:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79050000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875731708664064:0@lo:5: 00000100:00100000:0.0:1788837260.358078:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837260.358194:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca4186bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837260.358277:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708664064 00000100:00100000:3.0:1788837260.358284:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708664064 00000100:00100000:0.0:1788837260.358692:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837260.358702:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8101:x1875731708664064:12345-0@lo:5: 00002000:00080000:0.0:1788837260.370007:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788837260.370026:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:1.0:1788837260.373164:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79050000 x1875731708664064/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837276 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837260.373184:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79050000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875731708664064:0@lo:5: 00000004:00080000:1.0:1788837260.373199:0:8101:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788837260.373215:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8101:x1875731708664064:12345-0@lo:5: Request processed in 14398us (15020us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788837260.373225:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788837261.029481:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837262.053647:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837262.187550:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837262.187587:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708664192:0@lo:13: 00000100:00100000:2.0:1788837262.187686:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837262.187784:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708664192 00000100:00100000:2.0:1788837262.187794:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708664192 00000100:00100000:2.0:1788837262.187863:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837262.187875:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708664192:12345-0@lo:13: 00002000:00000024:2.0:1788837262.187928:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837262.188000:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708664192:12345-0@lo:13: Request processed in 126us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837262.188008:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788837262.188033:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837262.188069:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb58747800 x1875731708664192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837262.188092:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708664192:0@lo:13: 00000001:00080000:2.0:1788837262.973444:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788837263.078417:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837263.467678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837263.467761:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688718464 00000100:00100000:1.0:1788837263.467771:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688718464 00000100:00100000:1.0:1788837263.467814:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:1.0:1788837263.467822:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1875731688718464:12345-192.168.203.43@tcp:250: 00010000:00080000:1.0:1788837263.467858:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a575dfc0-4c49-4066-9796-b14a96701d37@192.168.203.43@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1788837263.467892:0:5838:0:(genops.c:1385:class_connect()) connect: client a575dfc0-4c49-4066-9796-b14a96701d37, cookie 0x843cbef8be30534e 00000100:00080000:1.0:1788837263.468043:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9acb6a778000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837263.468113:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+5:2357:x1875731688718464:12345-192.168.203.43@tcp:250: Request processed in 289us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837263.468121:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:1.0:1788837263.481579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837263.481903:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688718592 00000100:00100000:2.0:1788837263.481915:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688718592 00000100:00100000:2.0:1788837263.481969:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:2.0:1788837263.482005:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+5:5584:x1875731688718592:12345-192.168.203.43@tcp:101: 00010000:00010000:2.0:1788837263.482022:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837263.482039:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb935 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837263.482074:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb935 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837263.482086:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb935 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837263.482096:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5800, rc 0) 00000100:00100000:2.0:1788837263.482159:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+6:5584:x1875731688718592:12345-192.168.203.43@tcp:101: Request processed in 171us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837263.482167:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:3.0:1788837263.488203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837263.488276:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688718720 00000100:00100000:0.0:1788837263.488286:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688718720 00000100:00100000:0.0:1788837263.488350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:0.0:1788837263.488360:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+6:5584:x1875731688718720:12345-192.168.203.43@tcp:501: 00000100:00100000:0.0:1788837263.488669:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+6:5584:x1875731688718720:12345-192.168.203.43@tcp:501: Request processed in 310us (474us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837263.488683:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:3.0:1788837263.493711:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837263.493799:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688718848 00000100:00100000:2.0:1788837263.493809:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688718848 00000100:00100000:2.0:1788837263.494011:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:2.0:1788837263.494022:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+6:5584:x1875731688718848:12345-192.168.203.43@tcp:101: 00010000:00010000:2.0:1788837263.494040:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837263.494057:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb93c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837263.494085:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb93c expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837263.494097:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb93c expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837263.494107:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4c00, rc 0) 00000100:00100000:2.0:1788837263.494177:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+7:5584:x1875731688718848:12345-192.168.203.43@tcp:101: Request processed in 156us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837263.494184:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:3.0:1788837263.495826:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837263.501285:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688718976 00000100:00100000:0.0:1788837263.501299:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688718976 00000100:00100000:0.0:1788837263.501365:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:0.0:1788837263.501374:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+7:5584:x1875731688718976:12345-192.168.203.43@tcp:501: 00000100:00100000:0.0:1788837263.501633:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+8:5584:x1875731688718976:12345-192.168.203.43@tcp:501: Request processed in 258us (5813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837263.501641:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:0.0:1788837263.510558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837263.510645:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688719104 00000100:00100000:1.0:1788837263.510656:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688719104 00000100:00100000:1.0:1788837263.510711:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:1.0:1788837263.510720:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+8:5584:x1875731688719104:12345-192.168.203.43@tcp:503: 00000100:00100000:1.0:1788837263.511460:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+8:5584:x1875731688719104:12345-192.168.203.43@tcp:503: Request processed in 737us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837263.511483:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:0.0:1788837263.521588:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837263.524485:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688719232 00000100:00100000:1.0:1788837263.524502:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688719232 00000100:00100000:1.0:1788837263.524559:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:1.0:1788837263.524568:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+8:5603:x1875731688719232:12345-192.168.203.43@tcp:502: 00000100:00100000:1.0:1788837263.525166:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+8:5603:x1875731688719232:12345-192.168.203.43@tcp:502: Request processed in 595us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837263.525175:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:1.0:1788837263.562385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837263.562464:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688719360 00000100:00100000:3.0:1788837263.562474:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688719360 00000100:00100000:3.0:1788837263.562529:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:3.0:1788837263.562538:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+8:5603:x1875731688719360:12345-192.168.203.43@tcp:502: 00000100:00100000:3.0:1788837263.562792:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+8:5603:x1875731688719360:12345-192.168.203.43@tcp:502: Request processed in 254us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837263.562800:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:0.0:1788837263.577393:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837263.577474:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688719488 00000100:00100000:1.0:1788837263.577484:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688719488 00000100:00100000:1.0:1788837263.577534:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:1.0:1788837263.577544:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+8:5584:x1875731688719488:12345-192.168.203.43@tcp:101: 00010000:00010000:1.0:1788837263.577560:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837263.577577:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f577800/0x843cbef8be305363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb966 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837263.577604:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577800/0x843cbef8be305363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb966 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837263.577615:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f577800/0x843cbef8be305363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb966 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837263.577624:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577800, rc 0) 00000100:00100000:1.0:1788837263.577685:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+9:5584:x1875731688719488:12345-192.168.203.43@tcp:101: Request processed in 142us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837263.577691:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:0.0:1788837263.582493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837263.582579:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688719616 00000100:00100000:3.0:1788837263.582589:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688719616 00000100:00100000:3.0:1788837263.582643:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:3.0:1788837263.582653:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+9:5584:x1875731688719616:12345-192.168.203.43@tcp:256: 20000000:01000000:3.0:1788837263.582675:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788837263.582697:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788837263.582701:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788837263.582704:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788837263.582706:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788837263.588726:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+9:5584:x1875731688719616:12345-192.168.203.43@tcp:256: Request processed in 6064us (6232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837263.588740:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:1.0:1788837263.595373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837263.595572:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688719744 00000100:00100000:3.0:1788837263.595593:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688719744 00000100:00100000:3.0:1788837263.595675:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:3.0:1788837263.595686:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+9:5584:x1875731688719744:12345-192.168.203.43@tcp:101: 00010000:00010000:3.0:1788837263.595715:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837263.595733:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb96d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837263.595962:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb96d expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837263.596007:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb96d expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837263.596016:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2200, rc 0) 00000100:00100000:3.0:1788837263.596128:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:5584:x1875731688719744:12345-192.168.203.43@tcp:101: Request processed in 444us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837263.596144:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:0.0:1788837263.599692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837263.600646:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688719872 00000100:00100000:3.0:1788837263.600657:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688719872 00000100:00100000:3.0:1788837263.600712:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:3.0:1788837263.600722:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:5584:x1875731688719872:12345-192.168.203.43@tcp:501: 00000100:00100000:3.0:1788837263.601265:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:5584:x1875731688719872:12345-192.168.203.43@tcp:501: Request processed in 543us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837263.601274:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:0.0:1788837263.603606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837263.603890:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688720000 00000100:00100000:3.0:1788837263.603902:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688720000 00000100:00100000:3.0:1788837263.603956:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:3.0:1788837263.603965:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:5584:x1875731688720000:12345-192.168.203.43@tcp:503: 00000100:00100000:3.0:1788837263.604504:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:5584:x1875731688720000:12345-192.168.203.43@tcp:503: Request processed in 537us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837263.604522:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:3.0:1788837263.609890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837263.610572:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688720128 00000100:00100000:0.0:1788837263.610587:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688720128 00000100:00100000:0.0:1788837263.610655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:0.0:1788837263.610668:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:5608:x1875731688720128:12345-192.168.203.43@tcp:502: 00000100:00100000:0.0:1788837263.611056:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:5608:x1875731688720128:12345-192.168.203.43@tcp:502: Request processed in 390us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837263.611065:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:0.0:1788837263.620288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837263.626210:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688720256 00000100:00100000:2.0:1788837263.626225:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688720256 00000100:00100000:3.0:1788837263.626502:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:3.0:1788837263.626518:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+10:5608:x1875731688720256:12345-192.168.203.43@tcp:502: 00000100:00100000:3.0:1788837263.626812:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+10:5608:x1875731688720256:12345-192.168.203.43@tcp:502: Request processed in 297us (6531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837263.626822:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:2.0:1788837263.636059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837263.636187:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688720384 00000100:00100000:0.0:1788837263.636203:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688720384 00000100:00100000:0.0:1788837263.636266:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1788837263.636275:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875731688720384:12345-192.168.203.43@tcp:38: 00010000:00080000:0.0:1788837263.636342:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1788837263.636387:0:5846:0:(genops.c:1385:class_connect()) connect: client 4c93969d-0d98-4501-b440-fa8ca1cd6478, cookie 0x843cbef8be305371 00000004:00100000:0.0:1788837263.636417:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788837263.636423:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788837263.698544:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9acb7915a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837263.698655:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2357:x1875731688720384:12345-192.168.203.43@tcp:38: Request processed in 62376us (62607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837263.698668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00010000:00010000:1.0:1788837264.101704:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837264.711565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837264.711645:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688720512 00000100:00100000:3.0:1788837264.711663:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688720512 00000100:00100000:3.0:1788837264.711741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1788837264.711753:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:0:x1875731688720512:12345-192.168.203.43@tcp:41: 00000004:00000024:3.0:1788837264.711795:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788837264.711865:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:0:x1875731688720512:12345-192.168.203.43@tcp:41: Request processed in 115us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837264.711872:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00080000:2.0:1788837264.712060:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837264.716392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837264.717139:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688720640 00000100:00100000:2.0:1788837264.717149:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688720640 00000100:00100000:2.0:1788837264.717222:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1788837264.717234:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:5584:x1875731688720640:12345-192.168.203.43@tcp:41: 00000004:00000024:2.0:1788837264.717266:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788837264.717376:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:5584:x1875731688720640:12345-192.168.203.43@tcp:41: Request processed in 144us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837264.717384:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1788837264.727128:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837264.727591:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688720768 00000100:00100000:3.0:1788837264.727604:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688720768 00000100:00100000:3.0:1788837264.727671:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1788837264.727682:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:5584:x1875731688720768:12345-192.168.203.43@tcp:40: 00000100:00100000:3.0:1788837264.727807:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:5584:x1875731688720768:12345-192.168.203.43@tcp:40: Request processed in 127us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837264.727814:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1788837264.731075:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837264.731134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837264.731236:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688720896 00000100:00100000:1.0:1788837264.731246:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688720896 00000100:00100000:1.0:1788837264.731290:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:1.0:1788837264.731297:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875731688720896:12345-192.168.203.43@tcp:8: 00010000:00080000:1.0:1788837264.731348:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1788837264.731385:0:6698:0:(genops.c:1385:class_connect()) connect: client 4c93969d-0d98-4501-b440-fa8ca1cd6478, cookie 0x843cbef8be305378 00002000:00100000:1.0:1788837264.731396:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c93969d-0d98-4501-b440-fa8ca1cd6478/ffff9acb6a77e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837264.731417:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788837264.731691:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688721152 00000100:00100000:0.0:1788837264.731696:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688721152 00000100:00100000:0.0:1788837264.731738:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:0.0:1788837264.731746:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:2358:x1875731688721152:12345-192.168.203.43@tcp:400: 00002000:00080000:1.0:1788837264.731752:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788837264.731779:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9acb6a77c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837264.731805:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2357:x1875731688720896:12345-192.168.203.43@tcp:8: Request processed in 507us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837264.731805:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:2358:x1875731688721152:12345-192.168.203.43@tcp:400: Request processed in 59us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837264.731814:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1788837264.731814:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:1.0:1788837264.734215:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837264.734925:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688721280 00000100:00100000:2.0:1788837264.734935:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688721280 00000100:00100000:2.0:1788837264.734996:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1788837264.735008:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:5584:x1875731688721280:12345-192.168.203.43@tcp:33: 00000100:00100000:3.0:1788837264.736683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837264.736781:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688721024 00000100:00100000:0.0:1788837264.736788:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688721024 00000100:00100000:0.0:1788837264.736828:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1788837264.736835:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875731688721024:12345-192.168.203.43@tcp:8: 00010000:00080000:0.0:1788837264.736861:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1788837264.736889:0:6700:0:(genops.c:1385:class_connect()) connect: client 4c93969d-0d98-4501-b440-fa8ca1cd6478, cookie 0x843cbef8be30537f 00002000:00100000:0.0:1788837264.736912:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c93969d-0d98-4501-b440-fa8ca1cd6478/ffff9acb7ae28800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788837264.736933:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788837264.737261:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788837264.737288:0:6700:0:(import.c:65:import_set_state_nolock()) ffff9acb7ae2e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837264.737547:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2357:x1875731688721024:12345-192.168.203.43@tcp:8: Request processed in 709us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837264.737556:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000004:00080000:0.0:1788837264.772038:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36965us 00000004:00200000:2.0:1788837264.789531:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788837264.789647:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:5584:x1875731688721280:12345-192.168.203.43@tcp:33: Request processed in 54636us (55434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837264.789658:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1788837264.973065:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837264.973753:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688721408 00000100:00100000:0.0:1788837264.973763:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688721408 00000100:00100000:0.0:1788837264.973825:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1788837264.974647:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:5626:x1875731688721408:12345-192.168.203.43@tcp:101: 00010000:00010000:0.0:1788837264.974670:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837264.974732:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb997 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837264.974792:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be30538d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837264.974806:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be30538d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837264.974820:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be30538d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837264.975688:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788837264.975693:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837264.975711:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be30538d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837264.975738:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb997 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837264.975756:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be30538d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb997 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837264.975765:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837264.975779:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837264.975783:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031a00, rc 0) 00000100:00100000:0.0:1788837264.975942:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:5626:x1875731688721408:12345-192.168.203.43@tcp:101: Request processed in 1303us (2885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837264.975956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00010000:00010000:0.0:1788837265.125635:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837265.253879:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708664704:0@lo:400: 00000100:00100000:0.0:1788837265.253997:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837265.254063:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708664704 00000100:00100000:1.0:1788837265.254075:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708664704 00000100:00100000:0.0:1788837265.254096:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788837265.254105:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708664576:0@lo:400: 00000100:00100000:0.0:1788837265.254141:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837265.254153:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708664576 00000100:00100000:1.0:1788837265.254160:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708664576 00000100:00100000:0.0:1788837265.254165:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708665088:0@lo:400: 00000100:00100000:0.0:1788837265.254206:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837265.254213:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837265.254229:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708664704:12345-0@lo:400: 00000100:00100000:0.0:1788837265.254266:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837265.254281:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708664576:12345-0@lo:400: 00000100:00100000:0.0:1788837265.254368:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708664576:12345-0@lo:400: Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837265.254567:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708664704:12345-0@lo:400: Request processed in 341us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837265.254577:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788837265.254603:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837265.254821:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788837265.254913:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708664320:0@lo:400: 00000100:00100000:3.0:1788837265.254960:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837265.255003:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708664832:0@lo:400: 00000100:00100000:3.0:1788837265.255030:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837265.255068:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788837265.255075:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708664448:0@lo:13: 00000100:00100000:3.0:1788837265.255109:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837265.255131:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708664960:0@lo:400: 00000100:00100000:3.0:1788837265.255154:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837265.255189:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708664320 00000100:00100000:3.0:1788837265.255196:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708664320 00000100:00100000:3.0:1788837265.255236:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788837265.255244:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708664320:12345-0@lo:400: 00000100:00100000:3.0:1788837265.255287:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708664320:12345-0@lo:400: Request processed in 44us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837265.255294:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788837265.255342:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708664448 00000100:00100000:3.0:1788837265.255347:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708664448 00000100:00100000:3.0:1788837265.255385:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837265.255392:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708664448:12345-0@lo:13: 00002000:00000024:3.0:1788837265.255409:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837265.255442:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708664448:12345-0@lo:13: Request processed in 51us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837265.255448:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788837265.255783:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788837265.255833:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb457abb80 x1875731708664448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837265.255845:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708664576:0@lo:400: 00000100:00100000:1.0:1788837265.255875:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708664704:0@lo:400: 00000100:00100000:3.0:1788837265.255883:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788837265.255920:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708664448:0@lo:13: 00000100:00100000:1.0:1788837265.255930:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708665088 00000100:00100000:1.0:1788837265.255937:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708665088 00000100:00100000:3.0:1788837265.255942:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708664320:0@lo:400: 00000100:00100000:3.0:1788837265.256001:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708664960 00000100:00100000:1.0:1788837265.256005:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708664832 00000100:00100000:3.0:1788837265.256007:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708664960 00000100:00100000:1.0:1788837265.256014:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708664832 00000100:00100000:1.0:1788837265.256055:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837265.256067:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708665088:12345-0@lo:400: 00000100:00100000:3.0:1788837265.256087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788837265.256100:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708664960:12345-0@lo:400: 00000100:00100000:1.0:1788837265.256152:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708665088:12345-0@lo:400: Request processed in 85us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837265.256161:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837265.256175:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708664960:12345-0@lo:400: Request processed in 74us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837265.256185:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837265.256192:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837265.256206:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708664832:12345-0@lo:400: 00000100:00080000:3.0:1788837265.256216:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837265.256223:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837265.256252:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708664960:0@lo:400: 00010000:00080000:2.0:1788837265.256547:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79050e00 x1875731708665088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837265.256559:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708665088:0@lo:400: 00000100:00100000:1.0:1788837265.261920:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708664832:12345-0@lo:400: Request processed in 5707us (6879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837265.261934:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788837265.262164:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79050a80 x1875731708664832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837265.262187:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708664832:0@lo:400: 00010000:00010000:1.0:1788837266.151205:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788837266.908794:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00010000:00010000:0.0:1788837267.175334:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837267.227651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837267.227743:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688721536 00000100:00100000:0.0:1788837267.227755:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688721536 00000100:00100000:0.0:1788837267.227862:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1788837267.227875:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:5678:x1875731688721536:12345-192.168.203.43@tcp:41: 00000004:00000024:0.0:1788837267.227930:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788837267.228023:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:5678:x1875731688721536:12345-192.168.203.43@tcp:41: Request processed in 151us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837267.228048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00080000:3.0:1788837267.229080:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837267.231444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837267.231597:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688721664 00000100:00100000:3.0:1788837267.231611:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688721664 00000100:00100000:3.0:1788837267.231704:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1788837267.231717:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:5678:x1875731688721664:12345-192.168.203.43@tcp:13: 00002000:00000024:3.0:1788837267.231762:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788837267.232092:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837267.232205:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:5678:x1875731688721664:12345-192.168.203.43@tcp:13: Request processed in 488us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837267.232232:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1788837267.237546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837267.237971:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688721792 00000100:00100000:3.0:1788837267.237985:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688721792 00000100:00080000:0.0:1788837267.238152:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837267.238243:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1788837267.238267:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:5678:x1875731688721792:12345-192.168.203.43@tcp:13: 00002000:00000024:3.0:1788837267.238356:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837267.238448:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:5678:x1875731688721792:12345-192.168.203.43@tcp:13: Request processed in 195us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837267.238456:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:1.0:1788837267.302360:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708665216:0@lo:13: 00000100:00100000:1.0:1788837267.302456:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837267.302784:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708665216 00000100:00100000:2.0:1788837267.302795:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708665216 00000100:00100000:2.0:1788837267.302899:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837267.302911:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708665216:12345-0@lo:13: 00002000:00000024:2.0:1788837267.302939:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837267.303008:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708665216:12345-0@lo:13: Request processed in 100us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837267.303016:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788837267.303103:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837267.303359:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb58747480 x1875731708665216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837267.303384:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708665216:0@lo:13: 00010000:00010000:1.0:1788837268.197763:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788837268.916281:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000001:00100000:2.0:1788837268.920044:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00010000:00010000:0.0:1788837269.221956:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837269.799169:0:8305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788837269.814631:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837269.814694:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837269.814738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837269.814757:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688722176 00000100:00100000:0.0:1788837269.814771:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688722176 00000100:00100000:1.0:1788837269.814775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837269.814805:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688722304 00000100:00100000:1.0:1788837269.814808:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688722304 00000100:00100000:2.0:1788837269.814868:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688722048 00000100:00100000:0.0:1788837269.814868:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1788837269.814873:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688722048 00000100:00100000:0.0:1788837269.814882:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688722176:12345-192.168.203.43@tcp:400: 00000100:00100000:2.0:1788837269.814907:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1788837269.814914:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688722048:12345-192.168.203.43@tcp:400: 00000100:00100000:3.0:1788837269.815105:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688721920 00000100:00100000:3.0:1788837269.815111:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688721920 00000100:00100000:3.0:1788837269.815145:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:3.0:1788837269.815154:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2361:x1875731688721920:12345-192.168.203.43@tcp:400: 00000100:00100000:2.0:1788837269.815223:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688722048:12345-192.168.203.43@tcp:400: Request processed in 308us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837269.815231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1788837269.815722:0:6701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788837269.815733:0:6701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788837269.817262:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688722176:12345-192.168.203.43@tcp:400: Request processed in 2371us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837269.817279:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:0.0:1788837269.817739:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:0.0:1788837269.817757:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688722304:12345-192.168.203.43@tcp:400: 00000100:00100000:3.0:1788837269.818163:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2361:x1875731688721920:12345-192.168.203.43@tcp:400: Request processed in 3007us (3544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837269.818175:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:0.0:1788837269.818220:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688722304:12345-192.168.203.43@tcp:400: Request processed in 471us (3442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837269.818227:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00080000:0.0:1788837269.818252:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837269.818259:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837269.818262:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837270.245581:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837270.373640:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837270.374333:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708665472:0@lo:400: 00000100:00100000:2.0:1788837270.374443:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837270.374545:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708665344:0@lo:13: 00000100:00100000:2.0:1788837270.374576:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837270.375263:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708665344 00000100:00100000:0.0:1788837270.375276:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708665344 00000100:00100000:3.0:1788837270.375368:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708665472 00000100:00100000:3.0:1788837270.375375:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708665472 00000100:00100000:0.0:1788837270.375380:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837270.375395:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708665344:12345-0@lo:13: 00000100:00100000:3.0:1788837270.375417:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788837270.375428:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708665472:12345-0@lo:400: 00002000:00000024:0.0:1788837270.375445:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837270.375518:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708665344:12345-0@lo:13: Request processed in 126us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837270.375521:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708665472:12345-0@lo:400: Request processed in 93us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837270.375530:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788837270.375571:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708665472:0@lo:400: 00010000:00080000:2.0:1788837270.375593:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb457a8700 x1875731708665344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837270.375604:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788837270.375612:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837270.375621:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708665344:0@lo:13: 00000100:00100000:3.0:1788837270.376038:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708665600:0@lo:400: 00000100:00100000:1.0:1788837270.376068:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708665856:0@lo:400: 00000100:00100000:3.0:1788837270.376092:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837270.376119:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837270.376126:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708665728:0@lo:400: 00000100:00100000:1.0:1788837270.376134:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837270.376155:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837270.376194:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708665600 00000100:00100000:3.0:1788837270.376199:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708665600 00000100:00100000:0.0:1788837270.376220:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708665728 00000100:00100000:0.0:1788837270.376227:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708665728 00000100:00100000:3.0:1788837270.376237:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837270.376247:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708665600:12345-0@lo:400: 00000100:00100000:0.0:1788837270.376268:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837270.376279:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708665728:12345-0@lo:400: 00000100:00100000:3.0:1788837270.376294:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708665600:12345-0@lo:400: Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837270.376322:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788837270.376346:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708665728:12345-0@lo:400: Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837270.376355:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837270.376366:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708665728:0@lo:400: 00000100:00100000:2.0:1788837270.376379:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708665984:0@lo:400: 00000100:00080000:0.0:1788837270.376379:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837270.376383:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708665600:0@lo:400: 00000100:00100000:2.0:1788837270.376421:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837270.376462:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708665984 00000100:00100000:3.0:1788837270.376466:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708665984 00000100:00100000:3.0:1788837270.376504:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837270.376513:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708665984:12345-0@lo:400: 00000100:00100000:3.0:1788837270.376556:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708665984:12345-0@lo:400: Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837270.376563:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788837270.376793:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837270.377031:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708665984:0@lo:400: 00000100:00100000:3.0:1788837270.378063:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708665856 00000100:00100000:3.0:1788837270.378074:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708665856 00000100:00100000:3.0:1788837270.378165:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837270.378177:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708665856:12345-0@lo:400: 00000100:00100000:3.0:1788837270.378269:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708665856:12345-0@lo:400: Request processed in 95us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837270.378295:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788837270.378402:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837270.378534:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb457a8700 x1875731708665856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837270.378550:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708665856:0@lo:400: 00010000:00010000:0.0:1788837271.274418:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837272.293507:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837272.421623:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708666112:0@lo:13: 00000100:00100000:3.0:1788837272.421690:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837272.421985:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708666112 00000100:00100000:1.0:1788837272.421994:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708666112 00000100:00100000:1.0:1788837272.422065:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837272.422074:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708666112:12345-0@lo:13: 00002000:00000024:1.0:1788837272.422107:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837272.422160:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708666112:12345-0@lo:13: Request processed in 87us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837272.422166:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788837272.422246:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb58746d80 x1875731708666112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837272.422265:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708666112:0@lo:13: 00000100:00080000:2.0:1788837272.422366:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788837272.863231:0:8453:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9f7908a0 20000000:00000080:0.0:1788837272.863247:0:8453:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9acb754ec800 uarg=0000000000000000 20000000:01000000:0.0:1788837272.863279:0:8453:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788837272.863281:0:8453:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788837272.863284:0:8453:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788837272.863288:0:8453:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788837272.863292:0:8453:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788837272.863331:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788837272.863334:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788837272.863541:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788837272.863543:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788837272.877491:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788837272.877992:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788837272.878430:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788837272.878476:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788837272.878502:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788837272.878505:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788837272.883672:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788837272.884175:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788837272.884240:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788837272.884276:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788837272.884290:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788837272.884292:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788837272.885562:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788837272.886446:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788837272.886515:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788837272.886555:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788837272.886568:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788837272.886571:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788837272.887673:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788837272.888266:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788837272.888354:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788837272.888412:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1788837272.888429:0:8453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788837272.888448:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888465:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30528a expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888473:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052b4 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888479:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052de expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888494:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052ec expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888501:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052fa expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888509:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305316 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888516:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305340 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888524:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb935 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888532:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb93c expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888539:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888577:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb93c expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888593:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb93c expref: 9 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.888607:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666240:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837272.888723:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb935 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888738:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb935 expref: 9 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.888747:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666368:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837272.888782:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305340 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888791:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305340 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.888799:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666496:0@lo:104: 00000100:00100000:3.0:1788837272.888855:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837272.888885:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305316 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.888893:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305316 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.888902:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666624:0@lo:104: 00000100:00100000:2.0:1788837272.889270:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708666496 00000100:00100000:2.0:1788837272.889287:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708666496 00000100:00100000:2.0:1788837272.889354:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837272.889364:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:8453:x1875731708666496:12345-0@lo:104: 00010000:00010000:2.0:1788837272.889376:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837272.889426:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837272.889433:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:8453:x1875731708666496:12345-0@lo:104: Request processed in 72us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837272.889440:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788837272.889460:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837272.889466:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837272.889472:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f3e00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:2.0:1788837272.889476:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837272.889484:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837272.889490:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837272.889495:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788837272.889520:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837272.889537:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837272.889557:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837272.889563:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be305340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305347 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837272.889576:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837272.889578:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837272.889579:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837272.889598:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708666752:0@lo:103: 00000100:00100000:2.0:1788837272.889636:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837272.889680:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708666752 00000100:00100000:2.0:1788837272.889684:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708666752 00010000:00010000:2.0:1788837272.889700:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305340 expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837272.889720:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837272.889726:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708666752:12345-0@lo:103: 00010000:00010000:2.0:1788837272.889737:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837272.889741:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305340 expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837272.889749:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305340 expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837272.889764:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837272.889790:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708666752:12345-0@lo:103: Request processed in 64us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837272.889803:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837272.889847:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708666752:0@lo:103: 00000100:00100000:3.0:1788837272.890811:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837272.890870:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3052fa expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.890884:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3052fa expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.890894:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666880:0@lo:104: 00010000:00010000:3.0:1788837272.890937:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3052ec expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.890960:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3052ec expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.890968:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708667008:0@lo:104: 00010000:00010000:3.0:1788837272.890992:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3052de expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.890999:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3052de expref: 18 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.891005:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708667136:0@lo:104: 00010000:00010000:3.0:1788837272.891036:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3052b4 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.891043:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3052b4 expref: 18 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.891051:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708667264:0@lo:104: 00010000:00010000:3.0:1788837272.891075:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30528a expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.891081:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30528a expref: 18 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.891088:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708667392:0@lo:104: 00000100:00100000:3.0:1788837272.891104:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74e6f3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788837272.891120:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb4167b400/0x843cbef8be305347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305340 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.891144:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666496:0@lo:104: 00000100:00100000:0.0:1788837272.891208:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788837272.891227:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.891239:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.891247:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.891255:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.891263:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.891279:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708666624 00000100:00100000:0.0:1788837272.891284:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708666624 00000100:00100000:0.0:1788837272.891338:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708666880 00000100:00100000:0.0:1788837272.891341:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708666880 00000100:00100000:0.0:1788837272.891352:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708667008 00000100:00100000:0.0:1788837272.891355:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708667008 00000100:00100000:0.0:1788837272.891362:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708667136 00000100:00100000:0.0:1788837272.891364:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708667136 00000100:00100000:0.0:1788837272.891371:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708667264 00000100:00100000:0.0:1788837272.891374:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708667264 00000100:00100000:0.0:1788837272.891381:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708667392 00000100:00100000:0.0:1788837272.891382:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708667392 00000100:00100000:0.0:1788837272.891392:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837272.891400:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+8:8453:x1875731708666624:12345-0@lo:104: 00010000:00010000:0.0:1788837272.891410:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891459:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837272.891465:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+8:8453:x1875731708666624:12345-0@lo:104: Request processed in 66us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.891472:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837272.891507:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837272.891514:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+7:8453:x1875731708666880:12345-0@lo:104: 00010000:00010000:0.0:1788837272.891521:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891550:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788837272.891554:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+7:8453:x1875731708666880:12345-0@lo:104: Request processed in 43us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.891560:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837272.891579:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837272.891585:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+6:8453:x1875731708667008:12345-0@lo:104: 00010000:00010000:0.0:1788837272.891592:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891618:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788837272.891623:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+6:8453:x1875731708667008:12345-0@lo:104: Request processed in 39us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.891641:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837272.891652:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837272.891658:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:8453:x1875731708667136:12345-0@lo:104: 00010000:00010000:0.0:1788837272.891665:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891689:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788837272.891693:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:8453:x1875731708667136:12345-0@lo:104: Request processed in 36us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.891699:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837272.891710:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837272.891715:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79051500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:8453:x1875731708667264:12345-0@lo:104: 00010000:00010000:0.0:1788837272.891722:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891746:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788837272.891750:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79051500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:8453:x1875731708667264:12345-0@lo:104: Request processed in 36us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.891755:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837272.891773:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837272.891778:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:8453:x1875731708667392:12345-0@lo:104: 00010000:00010000:0.0:1788837272.891785:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891812:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788837272.891817:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:8453:x1875731708667392:12345-0@lo:104: Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.891822:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788837272.891837:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788837272.891843:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891850:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ac00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837272.891855:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891863:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837272.891869:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837272.891874:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837272.891902:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891908:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837272.891934:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891954:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30531d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891965:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788837272.891968:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891973:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576200 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837272.891976:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.891982:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837272.891992:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837272.891998:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837272.892012:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892017:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837272.892022:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892028:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3052fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305301 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892035:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788837272.892044:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892049:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a800 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837272.892052:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892057:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837272.892062:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837272.892067:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837272.892079:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892084:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837272.892097:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892103:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167a800/0x843cbef8be3052ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052f3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892111:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837272.892114:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892120:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ae00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837272.892123:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892141:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837272.892147:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837272.892151:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837272.892165:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892170:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837272.892175:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892180:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be3052de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892188:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837272.892191:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892195:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030200 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837272.892197:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892203:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837272.892208:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837272.892219:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837272.892231:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892236:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837272.892240:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892246:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb40030200/0x843cbef8be3052b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052bb expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892254:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837272.892257:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892262:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167b600 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837272.892265:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892271:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837272.892275:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837272.892280:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837272.892289:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892294:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837272.892329:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892336:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167b600/0x843cbef8be30528a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305291 expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892349:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837272.892351:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837272.892353:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837272.892367:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708667520:0@lo:103: 00000100:00100000:0.0:1788837272.892397:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.892422:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708668032:0@lo:103: 00000100:00100000:0.0:1788837272.892439:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.892457:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788837272.892461:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708667648:0@lo:103: 00000100:00100000:0.0:1788837272.892480:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.892493:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708668160:0@lo:103: 00000100:00100000:0.0:1788837272.892510:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.892532:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708667520 00000100:00100000:0.0:1788837272.892537:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708667520 00010000:00010000:0.0:1788837272.892556:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305316 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837272.892569:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708668032 00000100:00100000:0.0:1788837272.892572:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708668032 00010000:00010000:0.0:1788837272.892582:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052b4 expref: 19 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837272.892590:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708667648 00000100:00100000:0.0:1788837272.892598:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708667648 00010000:00010000:0.0:1788837272.892611:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052fa expref: 20 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837272.892621:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708668160 00000100:00100000:0.0:1788837272.892623:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708668160 00010000:00010000:0.0:1788837272.892632:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30528a expref: 21 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837272.892644:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837272.892650:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+21:3315:x1875731708667520:12345-0@lo:103: 00010000:00010000:0.0:1788837272.892660:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837272.892664:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305316 expref: 21 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892673:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305316 expref: 21 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892691:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837272.892718:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+21:3315:x1875731708667520:12345-0@lo:103: Request processed in 68us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.892725:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837272.892738:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837272.892743:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3315:x1875731708668032:12345-0@lo:103: 00010000:00010000:0.0:1788837272.892750:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837272.892754:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052b4 expref: 20 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892761:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3052b4 expref: 20 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892778:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837272.892800:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3315:x1875731708668032:12345-0@lo:103: Request processed in 57us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.892807:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837272.892820:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837272.892826:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708667648:12345-0@lo:103: 00010000:00010000:0.0:1788837272.892833:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837272.892837:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052fa expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892845:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3052fa expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892854:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837272.892873:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708667648:12345-0@lo:103: Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.892878:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837272.892890:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837272.892896:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3315:x1875731708668160:12345-0@lo:103: 00010000:00010000:0.0:1788837272.892904:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837272.892907:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30528a expref: 18 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892928:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30528a expref: 18 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.892938:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837272.892963:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3315:x1875731708668160:12345-0@lo:103: Request processed in 68us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.892969:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837272.892994:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708667776:0@lo:103: 00000100:00100000:0.0:1788837272.893029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.893049:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837272.893054:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708667904:0@lo:103: 00000100:00100000:0.0:1788837272.893075:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837272.893101:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708667776 00000100:00100000:0.0:1788837272.893105:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708667776 00010000:00010000:0.0:1788837272.893118:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052ec expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837272.893130:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708667904 00000100:00100000:0.0:1788837272.893132:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708667904 00010000:00010000:0.0:1788837272.893141:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052de expref: 19 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837272.893152:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837272.893157:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708667776:12345-0@lo:103: 00010000:00010000:0.0:1788837272.893164:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837272.893167:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052ec expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.893175:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3052ec expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.893186:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837272.893211:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708667776:12345-0@lo:103: Request processed in 54us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.893226:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837272.893238:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837272.893247:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3313:x1875731708667904:12345-0@lo:103: 00010000:00010000:0.0:1788837272.893256:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837272.893259:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052de expref: 18 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.893267:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3052de expref: 18 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.893276:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837272.893297:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3313:x1875731708667904:12345-0@lo:103: Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.893331:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837272.893376:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708667904:0@lo:103: 00000100:00100000:0.0:1788837272.893384:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708667776:0@lo:103: 00010000:00010000:0.0:1788837272.893407:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837272.893423:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708667648:0@lo:103: 00000100:00100000:0.0:1788837272.893430:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708668160:0@lo:103: 00000100:00100000:0.0:1788837272.893436:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708667520:0@lo:103: 00000100:00100000:0.0:1788837272.893442:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708668032:0@lo:103: 00010000:00010000:3.0:1788837272.894450:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f577200/0x843cbef8be30531d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305316 expref: 17 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.894467:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666624:0@lo:104: 00010000:00010000:3.0:1788837272.894479:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb4167b800/0x843cbef8be305301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3052fa expref: 16 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.894487:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666880:0@lo:104: 00010000:00010000:3.0:1788837272.894496:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40030400/0x843cbef8be3052f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3052ec expref: 15 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.894502:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708667008:0@lo:104: 00010000:00010000:3.0:1788837272.894510:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40030a00/0x843cbef8be3052e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3052de expref: 14 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.894517:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708667136:0@lo:104: 00010000:00010000:3.0:1788837272.894524:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f576000/0x843cbef8be3052bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3052b4 expref: 13 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.894531:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708667264:0@lo:104: 00010000:00010000:3.0:1788837272.894539:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40030600/0x843cbef8be305291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30528a expref: 12 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.894547:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708667392:0@lo:104: 00000100:00100000:0.0:1788837272.895607:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837272.895648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837272.895675:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688722432 00000100:00100000:0.0:1788837272.895691:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688722432 00010000:00010000:0.0:1788837272.895723:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb93c expref: 10 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837272.895747:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688722560 00000100:00100000:0.0:1788837272.895751:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688722560 00010000:00010000:0.0:1788837272.895762:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb935 expref: 11 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837272.895775:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1788837272.895783:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a575dfc0-4c49-4066-9796-b14a96701d37+11:2361:x1875731688722432:12345-192.168.203.43@tcp:103: 00010000:00010000:0.0:1788837272.896088:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837272.896096:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb93c expref: 11 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896108:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb93c expref: 11 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896127:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837272.896177:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a575dfc0-4c49-4066-9796-b14a96701d37+11:2361:x1875731688722432:12345-192.168.203.43@tcp:103: Request processed in 393us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.896185:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1788837272.896204:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:0.0:1788837272.896211:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a575dfc0-4c49-4066-9796-b14a96701d37+10:2360:x1875731688722560:12345-192.168.203.43@tcp:103: 00010000:00010000:0.0:1788837272.896218:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837272.896223:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb935 expref: 10 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896232:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb935 expref: 10 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896251:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896260:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896274:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896281:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896287:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896294:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896301:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837272.896331:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896339:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896348:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837272.896357:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837272.896378:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a575dfc0-4c49-4066-9796-b14a96701d37+10:2360:x1875731688722560:12345-192.168.203.43@tcp:103: Request processed in 168us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837272.896394:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00010000:00010000:3.0:1788837272.898752:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa4c00/0x843cbef8be30535c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb93c expref: 9 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.898795:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666240:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837272.898811:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa5800/0x843cbef8be305355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb935 expref: 8 pid: 5839 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837272.899112:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875731708666368:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837272.899158:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.899167:0:8453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.899173:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837272.899179:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2400/0x843cbef8be305394 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837273.317477:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837274.348149:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788837274.917458:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788837274.917467:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb79181000 from 39 10000000:01000000:0.0:1788837274.917472:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837274.917520:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837274.917532:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837274.917543:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837274.917565:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708668288:0@lo:101: 00000100:00100000:0.0:1788837274.917645:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837274.917721:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b00240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837274.917846:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708668288 00000100:00100000:3.0:1788837274.917855:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708668288 00000100:00100000:3.0:1788837274.917917:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788837274.917926:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+12:5841:x1875731708668288:12345-0@lo:101: 00010000:00010000:3.0:1788837274.917939:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837274.917957:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f2400/0x843cbef8be3053a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30539b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.917978:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f2400/0x843cbef8be3053a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30539b expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.918008:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f2400/0x843cbef8be3053a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30539b expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.918018:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2400, rc 0) 00000100:00100000:3.0:1788837274.918060:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708668288:12345-0@lo:101: Request processed in 135us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837274.918066:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788837274.918400:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708668288:0@lo:101: 00010000:00010000:2.0:1788837274.918416:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837274.918426:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837274.918480:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708668416:0@lo:501: 00000100:00100000:2.0:1788837274.918508:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837274.918537:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837274.918590:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708668416 00000100:00100000:3.0:1788837274.918595:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708668416 00000100:00100000:3.0:1788837274.918630:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788837274.918638:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708668416:12345-0@lo:501: 00000100:00100000:3.0:1788837274.918911:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708668416:12345-0@lo:501: Request processed in 273us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837274.918918:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788837274.919033:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708668416:0@lo:501: 00000100:00100000:2.0:1788837274.919061:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708668544:0@lo:503: 00000100:00100000:2.0:1788837274.919100:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837274.919123:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837274.919148:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708668544 00000100:00100000:1.0:1788837274.919153:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708668544 00000100:00100000:1.0:1788837274.919190:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788837274.919197:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708668544:12345-0@lo:503: 00000100:00100000:1.0:1788837274.919558:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708668544:12345-0@lo:503: Request processed in 360us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837274.919567:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788837274.919604:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708668544:0@lo:503: 00000100:00100000:2.0:1788837274.920467:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8471:1875731708668672:0@lo:502: 00000100:00100000:2.0:1788837274.920515:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837274.920549:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837274.920606:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708668672 00000100:00100000:0.0:1788837274.920611:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708668672 00000100:00100000:0.0:1788837274.920651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788837274.920660:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:8471:x1875731708668672:12345-0@lo:502: 00000100:00100000:0.0:1788837274.920876:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:8471:x1875731708668672:12345-0@lo:502: Request processed in 217us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837274.920883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788837274.921107:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8471:1875731708668672:0@lo:502: 00000100:00100000:2.0:1788837274.921367:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8471:1875731708668800:0@lo:502: 00000100:00100000:2.0:1788837274.921404:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837274.921442:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837274.922911:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708668800 00000100:00100000:1.0:1788837274.922920:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708668800 00000100:00100000:1.0:1788837274.922977:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788837274.922986:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:8471:x1875731708668800:12345-0@lo:502: 00000100:00100000:1.0:1788837274.923622:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:8471:x1875731708668800:12345-0@lo:502: Request processed in 636us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837274.923631:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788837274.923736:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8471:1875731708668800:0@lo:502: 00000040:00080000:2.0:1788837274.923954:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788837274.924115:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788837274.924144:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837274.924382:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837274.924393:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837274.924402:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788837274.924405:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788837274.924407:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788837274.924437:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837274.924444:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837274.924452:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837274.924481:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708668928:0@lo:101: 00000100:00100000:1.0:1788837274.924519:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837274.924633:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d235600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837274.938449:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708668928 00000100:00100000:3.0:1788837274.938464:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708668928 00000100:00100000:3.0:1788837274.938543:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788837274.938553:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+13:5841:x1875731708668928:12345-0@lo:101: 00010000:00010000:3.0:1788837274.938569:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837274.938586:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f3c00/0x843cbef8be3053b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3053a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.938613:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f3c00/0x843cbef8be3053b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3053a9 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.938624:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f3c00/0x843cbef8be3053b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3053a9 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.938651:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f3c00, rc 0) 00000100:00100000:3.0:1788837274.938737:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708668928:12345-0@lo:101: Request processed in 186us (14217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837274.938744:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788837274.938853:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708668928:0@lo:101: 00010000:00010000:2.0:1788837274.938871:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837274.938881:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837274.938958:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669056:0@lo:501: 00000100:00100000:2.0:1788837274.938996:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837274.939018:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837274.939189:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708669056 00000100:00100000:1.0:1788837274.939194:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708669056 00000100:00100000:1.0:1788837274.939215:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788837274.939222:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708669056:12345-0@lo:501: 00000100:00100000:1.0:1788837274.939485:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708669056:12345-0@lo:501: Request processed in 263us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837274.939491:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788837274.939579:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669056:0@lo:501: 00000100:00100000:2.0:1788837274.939605:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669184:0@lo:503: 00000100:00100000:2.0:1788837274.939641:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837274.939657:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837274.939770:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708669184 00000100:00100000:3.0:1788837274.939775:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708669184 00000100:00100000:3.0:1788837274.939795:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788837274.939802:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708669184:12345-0@lo:503: 00000100:00100000:3.0:1788837274.939961:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708669184:12345-0@lo:503: Request processed in 159us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837274.939968:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788837274.940078:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669184:0@lo:503: 00000100:00100000:3.0:1788837274.941711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837274.941744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837274.941915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837274.941945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837274.941969:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688722688 00000100:00100000:3.0:1788837274.941975:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688722688 00000100:00100000:3.0:1788837274.942012:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:3.0:1788837274.942021:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+8:2360:x1875731688722688:12345-192.168.203.43@tcp:400: 00000100:00100000:3.0:1788837274.942080:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+8:2360:x1875731688722688:12345-192.168.203.43@tcp:400: Request processed in 60us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837274.942087:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:0.0:1788837274.943345:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688723072 00000100:00100000:0.0:1788837274.943356:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688723072 00000100:00100000:0.0:1788837274.943405:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688722944 00000100:00100000:0.0:1788837274.943408:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688722944 00000100:00100000:0.0:1788837274.943445:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1788837274.943454:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688723072:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1788837274.943500:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688723072:12345-192.168.203.43@tcp:400: Request processed in 47us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837274.943506:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1788837274.943520:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1788837274.943527:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688722944:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1788837274.943547:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688722944:12345-192.168.203.43@tcp:400: Request processed in 21us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837274.943554:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00080000:0.0:1788837274.943642:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837274.943646:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837274.949655:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688722816 00000100:00100000:1.0:1788837274.949675:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688722816 00000100:00100000:0.0:1788837274.949894:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:0.0:1788837274.949917:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688722816:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1788837274.950001:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688722816:12345-192.168.203.43@tcp:400: Request processed in 87us (8296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837274.950009:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00080000:2.0:1788837274.951520:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837274.954168:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8472:1875731708669312:0@lo:502: 00000100:00100000:3.0:1788837274.954248:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837274.954296:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb455280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837274.954446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708669312 00000100:00100000:0.0:1788837274.954453:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708669312 00000100:00100000:0.0:1788837274.954494:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788837274.954502:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:8472:x1875731708669312:12345-0@lo:502: 00000100:00100000:0.0:1788837274.954711:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:8472:x1875731708669312:12345-0@lo:502: Request processed in 209us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837274.954718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788837274.956525:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8472:1875731708669312:0@lo:502: 00000020:01000000:3.0:1788837274.956582:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837274.956595:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837274.956597:0:8472:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788837274.956603:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788837274.956635:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8472:1875731708669440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837274.956699:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837274.956746:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb455280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837274.959128:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708669440 00000100:00100000:1.0:1788837274.959140:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708669440 00000100:00100000:1.0:1788837274.959202:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788837274.959213:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:8472:x1875731708669440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837274.961062:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:8472:x1875731708669440:12345-0@lo:502:llog_process_th.0 Request processed in 1842us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837274.961075:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788837274.963980:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8472:1875731708669440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837274.964030:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837274.964040:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837274.964043:0:8472:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788837274.964047:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788837274.964233:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788837274.964267:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788837274.964278:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837274.964289:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837274.964299:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788837274.964345:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb45cdf000 from 39 10000000:01000000:0.0:1788837274.964349:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837274.964382:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837274.964391:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837274.964400:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837274.964420:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837274.964483:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837274.964523:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b00180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837274.964965:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708669568 00000100:00100000:3.0:1788837274.964973:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708669568 00000100:00100000:3.0:1788837274.965023:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788837274.965033:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:5841:x1875731708669568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837274.965045:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837274.965058:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f2a00/0x843cbef8be3053be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3053b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.965081:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f2a00/0x843cbef8be3053be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3053b7 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.965091:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f2a00/0x843cbef8be3053be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3053b7 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.965099:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2a00, rc 0) 00000100:00100000:3.0:1788837274.965199:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708669568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837274.965214:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788837274.969476:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837274.969506:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837274.969519:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837274.974438:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837274.974511:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837274.974616:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb455289c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837274.976957:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708669696 00000100:00100000:1.0:1788837274.976971:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708669696 00000100:00100000:1.0:1788837274.981514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788837274.981530:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708669696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837274.982088:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708669696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 561us (7575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837274.982096:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788837274.982212:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837274.982267:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837274.982344:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837274.983120:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837274.983159:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708669824 00000100:00100000:1.0:1788837274.983166:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708669824 00000100:00100000:1.0:1788837274.983247:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788837274.983257:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708669824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837274.984083:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708669824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 824us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837274.984092:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788837274.984175:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708669824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837274.990272:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8473:1875731708669952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837274.990608:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837274.990650:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d235840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837274.993743:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708669952 00000100:00100000:2.0:1788837274.993757:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708669952 00000100:00100000:2.0:1788837274.993842:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788837274.993853:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:8473:x1875731708669952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837274.994173:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:8473:x1875731708669952:12345-0@lo:502:llog_process_th.0 Request processed in 322us (3565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837274.994182:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788837274.994503:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8473:1875731708669952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837274.994568:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8473:1875731708670080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837274.994612:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837274.994639:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d235840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837274.994963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708670080 00000100:00100000:0.0:1788837274.994969:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708670080 00000100:00100000:0.0:1788837274.995007:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788837274.995015:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:8473:x1875731708670080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837274.995204:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:8473:x1875731708670080:12345-0@lo:502:llog_process_th.0 Request processed in 189us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837274.995212:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788837274.996618:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8473:1875731708670080:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788837274.996661:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788837274.996942:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788837274.996960:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788837274.996970:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.996990:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837274.997000:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788837274.997003:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788837274.997006:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788837274.997039:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.997047:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.997055:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837274.997082:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837274.997131:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837274.997180:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb455289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837274.997290:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708670208 00000100:00100000:2.0:1788837274.997296:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708670208 00000100:00100000:2.0:1788837274.997370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788837274.997379:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:5841:x1875731708670208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837274.997390:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837274.997404:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa4000/0x843cbef8be3053cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3053c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837274.997425:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa4000/0x843cbef8be3053cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3053c5 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837274.997434:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa4000/0x843cbef8be3053cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3053c5 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837274.997443:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4000, rc 0) 00000100:00100000:2.0:1788837274.997506:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708670208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837274.997512:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788837274.997924:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837274.997939:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837274.997948:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837274.998008:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837274.998033:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837274.998063:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb455289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837274.998232:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708670336 00000100:00100000:2.0:1788837274.998237:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708670336 00000100:00100000:2.0:1788837274.998270:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788837274.998278:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708670336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837274.998619:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708670336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837274.998627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788837274.999905:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837274.999955:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837275.000526:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.000595:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b00780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837275.004701:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708670464 00000100:00100000:1.0:1788837275.004716:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708670464 00000100:00100000:1.0:1788837275.004788:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788837275.004798:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708670464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837275.005118:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708670464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 321us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837275.005126:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788837275.009598:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837275.020870:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8474:1875731708670592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837275.020980:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837275.021036:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50112600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837275.021106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708670592 00000100:00100000:3.0:1788837275.021114:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708670592 00000100:00100000:3.0:1788837275.021239:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788837275.021249:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:8474:x1875731708670592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837275.021915:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:8474:x1875731708670592:12345-0@lo:502:llog_process_th.0 Request processed in 666us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837275.021924:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788837275.021936:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8474:1875731708670592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837275.021967:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837275.021987:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837275.021990:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788837275.021997:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788837275.022022:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8474:1875731708670720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837275.022062:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837275.022093:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50112600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837275.022196:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708670720 00000100:00100000:2.0:1788837275.022202:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708670720 00000100:00100000:2.0:1788837275.022240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788837275.022250:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:8474:x1875731708670720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837275.022414:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:8474:x1875731708670720:12345-0@lo:502:llog_process_th.0 Request processed in 166us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837275.022421:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788837275.023396:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8474:1875731708670720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837275.023433:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837275.023440:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837275.023443:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788837275.023447:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788837275.024050:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788837275.024070:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788837275.024080:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.024091:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837275.024101:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788837275.024104:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb6a76b800 from 39 10000000:01000000:2.0:1788837275.024107:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837275.024147:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.024156:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.024164:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837275.024183:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837275.024234:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837275.024277:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837275.024604:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708670848 00000100:00100000:3.0:1788837275.024611:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708670848 00000100:00100000:3.0:1788837275.024654:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788837275.024662:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708670848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837275.024674:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837275.024686:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f2000/0x843cbef8be3053da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3053d3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837275.024709:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f2000/0x843cbef8be3053da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3053d3 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837275.024733:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f2000/0x843cbef8be3053da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3053d3 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837275.024743:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2000, rc 0) 00000100:00100000:3.0:1788837275.025655:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708670848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 988us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837275.025664:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788837275.026230:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837275.026253:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.026265:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837275.026361:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837275.026399:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837275.026427:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837275.026588:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708670976 00000100:00100000:1.0:1788837275.026594:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708670976 00000100:00100000:1.0:1788837275.026626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788837275.026635:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708670976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837275.027249:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708670976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 613us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837275.027256:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788837275.027565:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708670976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837275.027602:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708671104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837275.027643:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837275.027674:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837275.027910:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708671104 00000100:00100000:3.0:1788837275.027916:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708671104 00000100:00100000:3.0:1788837275.027954:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788837275.027963:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708671104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837275.029183:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708671104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1216us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837275.029193:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788837275.034015:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708671104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837275.035520:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8475:1875731708671232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837275.035605:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.035648:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837275.035690:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708671232 00000100:00100000:1.0:1788837275.035696:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708671232 00000100:00100000:1.0:1788837275.035731:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788837275.035740:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:8475:x1875731708671232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837275.036005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:8475:x1875731708671232:12345-0@lo:502:llog_process_th.0 Request processed in 265us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837275.036013:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788837275.036815:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8475:1875731708671232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837275.036870:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8475:1875731708671360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837275.036923:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.036945:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837275.037937:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708671360 00000100:00100000:2.0:1788837275.037946:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708671360 00000100:00100000:2.0:1788837275.038003:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788837275.038013:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:8475:x1875731708671360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837275.038258:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:8475:x1875731708671360:12345-0@lo:502:llog_process_th.0 Request processed in 246us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837275.038265:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788837275.038615:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8475:1875731708671360:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788837275.038642:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788837275.038782:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788837275.038809:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837275.038818:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837275.038839:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837275.038848:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788837275.038850:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788837275.038852:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788837275.038877:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837275.038885:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837275.038893:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837275.038921:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708671488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837275.038952:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837275.038987:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb480a0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837275.039510:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708671488 00000100:00100000:2.0:1788837275.039516:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708671488 00000100:00100000:2.0:1788837275.039549:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788837275.039556:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708671488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837275.039566:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837275.039577:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa5600/0x843cbef8be3053e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3053e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.039598:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa5600/0x843cbef8be3053e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3053e1 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.039608:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa5600/0x843cbef8be3053e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3053e1 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.039616:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5600, rc 0) 00000100:00100000:2.0:1788837275.039659:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708671488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837275.039664:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788837275.039906:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708671488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837275.039921:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837275.039930:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837275.040001:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708671616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837275.040030:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.040052:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837275.040210:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708671616 00000100:00100000:2.0:1788837275.040215:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708671616 00000100:00100000:2.0:1788837275.040251:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788837275.040266:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708671616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837275.040524:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708671616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837275.040530:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788837275.041000:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708671616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837275.041032:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708671744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837275.041071:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.041091:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837275.041184:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708671744 00000100:00100000:2.0:1788837275.041188:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708671744 00000100:00100000:2.0:1788837275.041219:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788837275.041225:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708671744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837275.041380:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708671744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837275.041386:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788837275.041473:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708671744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837275.041835:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8476:1875731708671872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837275.041871:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.041908:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837275.042100:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708671872 00000100:00100000:2.0:1788837275.042105:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708671872 00000100:00100000:2.0:1788837275.042136:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788837275.042144:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8476:x1875731708671872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837275.042327:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8476:x1875731708671872:12345-0@lo:502:llog_process_th.0 Request processed in 160us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837275.042334:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788837275.042421:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8476:1875731708671872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837275.042444:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837275.042464:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837275.042467:0:8476:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788837275.042471:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788837275.042489:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8476:1875731708672000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837275.042521:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.042541:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837275.042641:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708672000 00000100:00100000:2.0:1788837275.042645:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708672000 00000100:00100000:2.0:1788837275.042671:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788837275.042677:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8476:x1875731708672000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837275.042818:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8476:x1875731708672000:12345-0@lo:502:llog_process_th.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837275.042824:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788837275.043200:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8476:1875731708672000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837275.043221:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837275.043225:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837275.043227:0:8476:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788837275.043236:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788837275.043393:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788837275.043414:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788837275.043422:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.043431:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837275.043440:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788837275.043442:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9acb587319b8 from 1 10000000:01000000:2.0:1788837275.043445:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788837275.043480:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.043487:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.043494:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837275.043508:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708672128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837275.043538:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837275.043569:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fbac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837275.043616:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708672128 00000100:00100000:0.0:1788837275.043621:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708672128 00000100:00100000:0.0:1788837275.043654:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788837275.043662:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708672128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837275.043670:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837275.043680:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7917a800/0x843cbef8be3053f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3053ef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837275.043702:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7917a800/0x843cbef8be3053f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3053ef expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837275.043710:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7917a800/0x843cbef8be3053f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3053ef expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837275.043718:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917a800, rc 0) 00000100:00100000:0.0:1788837275.043748:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708672128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837275.043754:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788837275.044000:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708672128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837275.044013:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053f6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.044021:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053f6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837275.044065:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708672256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837275.044097:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837275.044120:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fbac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837275.044166:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708672256 00000100:00100000:1.0:1788837275.044171:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708672256 00000100:00100000:1.0:1788837275.044195:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788837275.044203:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708672256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837275.044451:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708672256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (352us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837275.044459:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788837275.046178:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708672256:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788837275.046221:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788837275.046232:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053f6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837275.046243:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053f6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837275.365754:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837275.494172:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708672640:0@lo:400:kworker.0 00000100:00100000:0.0:1788837275.494243:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.494296:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708673152:0@lo:400:kworker.0 00000100:00100000:0.0:1788837275.494347:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.494377:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837275.494383:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708672768:0@lo:400:kworker.0 00000100:00100000:0.0:1788837275.494404:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837275.494447:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708672640 00000100:00100000:0.0:1788837275.494468:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708672640 00000100:00100000:0.0:1788837275.494508:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708672768 00000100:00100000:0.0:1788837275.494511:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708672768 00000100:00100000:0.0:1788837275.494535:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788837275.494544:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708672640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837275.494605:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708672640:12345-0@lo:400:kworker.0 Request processed in 62us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837275.494612:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788837275.494633:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837275.494640:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708672768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837275.494666:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708672768:12345-0@lo:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837275.494671:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837275.494688:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708673152 00000100:00100000:0.0:1788837275.494691:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708673152 00000100:00100000:0.0:1788837275.494717:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837275.494723:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708673152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837275.494766:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708673152:12345-0@lo:400:kworker.0 Request processed in 43us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837275.494771:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788837275.495171:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708672384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837275.495208:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837275.495228:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708672896:0@lo:400:kworker.0 00000100:00100000:2.0:1788837275.495250:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837275.495267:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788837275.495274:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708672512:0@lo:400:kworker.0 00000100:00100000:2.0:1788837275.495322:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837275.495384:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708672384 00000100:00100000:1.0:1788837275.495390:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708672384 00000100:00100000:1.0:1788837275.495438:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837275.495457:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708672384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837275.495485:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837275.495525:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708672384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837275.495531:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788837275.495666:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708672896 00000100:00100000:3.0:1788837275.495671:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708672896 00000100:00100000:3.0:1788837275.495710:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837275.495718:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708672896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837275.495764:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708672896:12345-0@lo:400:kworker.0 Request processed in 47us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837275.495770:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788837275.495813:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837275.495818:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837275.495821:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837275.496541:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708673024:0@lo:400:kworker.0 00000100:00100000:2.0:1788837275.496588:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788837275.496631:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795ea300 x1875731708672384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837275.496651:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708672384:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788837275.496663:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79631c00 x1875731708672896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837275.496671:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708672896:0@lo:400:kworker.0 00000100:00100000:2.0:1788837275.496721:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708672512 00000100:00100000:2.0:1788837275.496725:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708672512 00000100:00100000:1.0:1788837275.496927:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708673024 00000100:00100000:1.0:1788837275.496941:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708673024 00000100:00100000:1.0:1788837275.496987:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837275.496995:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708673024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837275.497042:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708673024:12345-0@lo:400:kworker.0 Request processed in 47us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837275.497049:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788837275.497121:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837275.497149:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708673024:0@lo:400:kworker.0 00000100:00100000:2.0:1788837275.497775:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788837275.497791:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708672512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837275.497846:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708672512:12345-0@lo:400:kworker.0 Request processed in 58us (2542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837275.497852:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788837275.498346:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708672512:0@lo:400:kworker.0 00000100:00100000:0.0:1788837275.499201:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708672768:0@lo:400:kworker.0 00000100:00100000:0.0:1788837275.499214:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708672640:0@lo:400:kworker.0 00010000:00080000:0.0:1788837275.499226:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79631f80 x1875731708673152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837275.499236:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708673152:0@lo:400:kworker.0 00010000:00010000:0.0:1788837276.389560:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837277.413750:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837277.542047:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837277.542071:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708673280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837277.542136:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837277.542354:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708673280 00000100:00100000:2.0:1788837277.542373:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708673280 00000100:00100000:2.0:1788837277.542600:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788837277.542611:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708673280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837277.542646:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837277.542701:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708673280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837277.542708:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788837277.544661:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb58745880 x1875731708673280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837277.544686:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708673280:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837277.547301:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837278.007654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837278.007816:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688723200 00000100:00100000:1.0:1788837278.007833:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688723200 00000100:00100000:1.0:1788837278.007898:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:1.0:1788837278.007909:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+8:5599:x1875731688723200:12345-192.168.203.43@tcp:101: 00010000:00010000:1.0:1788837278.007925:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837278.007943:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f576000/0x843cbef8be3053fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb99e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837278.007971:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f576000/0x843cbef8be3053fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb99e expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837278.008003:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f576000/0x843cbef8be3053fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb99e expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837278.008013:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576000, rc 0) 00000100:00100000:1.0:1788837278.008073:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+9:5599:x1875731688723200:12345-192.168.203.43@tcp:101: Request processed in 166us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837278.008079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:0.0:1788837278.019478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837278.019561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688723328 00000100:00100000:3.0:1788837278.019571:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688723328 00000100:00100000:3.0:1788837278.019625:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:3.0:1788837278.019636:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+9:5599:x1875731688723328:12345-192.168.203.43@tcp:501: 00000100:00100000:3.0:1788837278.019943:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+9:5599:x1875731688723328:12345-192.168.203.43@tcp:501: Request processed in 307us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837278.019952:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:3.0:1788837278.024447:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837278.024548:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688723456 00000100:00100000:2.0:1788837278.024557:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688723456 00000100:00100000:2.0:1788837278.024609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:2.0:1788837278.024620:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+9:5599:x1875731688723456:12345-192.168.203.43@tcp:503: 00000100:00100000:2.0:1788837278.024855:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+9:5599:x1875731688723456:12345-192.168.203.43@tcp:503: Request processed in 236us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837278.024864:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:0.0:1788837278.032908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837278.034439:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688723584 00000100:00100000:1.0:1788837278.034451:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688723584 00000100:00100000:1.0:1788837278.034514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:1.0:1788837278.034524:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+9:6090:x1875731688723584:12345-192.168.203.43@tcp:502: 00000100:00100000:1.0:1788837278.034790:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+9:6090:x1875731688723584:12345-192.168.203.43@tcp:502: Request processed in 267us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837278.034798:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:0.0:1788837278.049768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837278.049909:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688723712 00000100:00100000:3.0:1788837278.049919:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688723712 00000100:00100000:3.0:1788837278.049972:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:3.0:1788837278.049982:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+9:6090:x1875731688723712:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837278.050524:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+9:6090:x1875731688723712:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 543us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837278.050533:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:3.0:1788837278.058524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837278.058671:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688723840 00000100:00100000:2.0:1788837278.058681:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688723840 00000100:00100000:2.0:1788837278.058738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:2.0:1788837278.058748:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+9:5599:x1875731688723840:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837278.058788:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837278.058805:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa5a00/0x843cbef8be305404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb9a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837278.058844:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa5a00/0x843cbef8be305404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9a5 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837278.058856:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa5a00/0x843cbef8be305404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9a5 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837278.058866:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5a00, rc 0) 00000100:00100000:2.0:1788837278.058932:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:5599:x1875731688723840:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 185us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837278.058939:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:0.0:1788837278.066555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837278.067480:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688723968 00000100:00100000:3.0:1788837278.067491:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688723968 00000100:00100000:3.0:1788837278.067551:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00100000:3.0:1788837278.067562:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+10:5599:x1875731688723968:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837278.067849:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+10:5599:x1875731688723968:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 289us (1302us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837278.067857:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 170 00010000:00010000:0.0:1788837278.438236:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788837279.251394:0:8513:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc53942e0 20000000:00000080:0.0:1788837279.251413:0:8513:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9acb795fc800 uarg=0000000000000000 20000000:01000000:0.0:1788837279.251450:0:8513:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788837279.251456:0:8513:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788837279.251460:0:8513:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788837279.252548:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788837279.252761:0:8513:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788837279.265973:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788837279.266029:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788837279.266082:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788837279.266112:0:8513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788837279.266131:0:8513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266150:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb40031800/0x843cbef8be305180 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305179 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266158:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3051db expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266283:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3052a6 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266300:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb96d expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266340:0:8513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266449:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb96d expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266463:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb96d expref: 9 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837279.266476:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875731708673408:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837279.266582:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3052a6 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266591:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3052a6 expref: 18 pid: 5839 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837279.266600:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875731708673536:0@lo:104: 00000100:00100000:2.0:1788837279.266639:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837279.266677:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3051db expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266685:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3051db expref: 18 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837279.266692:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875731708673664:0@lo:104: 00000100:00100000:2.0:1788837279.266723:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837279.266744:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb40031800/0x843cbef8be305180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305179 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.266752:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb40031800/0x843cbef8be305180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305179 expref: 18 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837279.266758:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875731708673792:0@lo:104: 00000100:00100000:2.0:1788837279.267433:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f732d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837279.267575:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788837279.267597:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837279.267611:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708673536 00000100:00100000:3.0:1788837279.267618:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708673536 00000100:00100000:3.0:1788837279.267663:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708673664 00000100:00100000:3.0:1788837279.267666:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708673664 00000100:00100000:3.0:1788837279.267677:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708673792 00000100:00100000:3.0:1788837279.267679:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708673792 00000100:00100000:3.0:1788837279.267691:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788837279.267699:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:8513:x1875731708673536:12345-0@lo:104: 00010000:00010000:3.0:1788837279.267711:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.267767:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837279.267780:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:8513:x1875731708673536:12345-0@lo:104: Request processed in 75us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837279.267787:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788837279.267805:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837279.267811:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:8513:x1875731708673664:12345-0@lo:104: 00010000:00010000:3.0:1788837279.267819:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.267853:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837279.267858:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:8513:x1875731708673664:12345-0@lo:104: Request processed in 49us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837279.267864:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837279.267904:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837279.267910:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:8513:x1875731708673792:12345-0@lo:104: 00010000:00010000:3.0:1788837279.267918:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.267956:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788837279.267961:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:8513:x1875731708673792:12345-0@lo:104: Request processed in 51us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837279.267966:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788837279.267986:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788837279.267991:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.267998:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031200 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837279.268002:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268010:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837279.268017:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837279.268022:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788837279.268049:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268055:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837279.268075:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268082:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb40031200/0x843cbef8be3052a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3052ad expref: -99 pid: 7635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268119:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837279.268123:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268128:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb41485600 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837279.268131:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268137:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837279.268142:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837279.268147:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788837279.268161:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837279.268519:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875731708673536:0@lo:104: 00000100:00100000:2.0:1788837279.268530:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875731708673664:0@lo:104: 00000100:00100000:2.0:1788837279.268537:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875731708673792:0@lo:104: 00010000:00010000:3.0:1788837279.268614:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837279.268623:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268629:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb41485600/0x843cbef8be3051db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3051e2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268649:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837279.268653:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268670:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2600 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837279.268673:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268680:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837279.268686:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837279.268691:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788837279.268708:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268714:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837279.268731:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268737:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be305179 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305180 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.268752:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837279.268755:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837279.268757:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837279.268775:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708673920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837279.268811:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837279.268844:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837279.268850:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708674048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837279.268895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837279.269121:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837279.270017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708673920 00000100:00100000:3.0:1788837279.270027:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708673920 00010000:00010000:3.0:1788837279.270062:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052a6 expref: 19 pid: 5839 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837279.270270:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837279.270284:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708674176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837279.270363:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837279.271628:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708674048 00000100:00100000:3.0:1788837279.271637:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708674048 00010000:00010000:3.0:1788837279.271734:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3051db expref: 20 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837279.271755:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708674176 00000100:00100000:3.0:1788837279.271759:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708674176 00010000:00010000:3.0:1788837279.271836:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb40031800/0x843cbef8be305180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305179 expref: 21 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837279.271856:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837279.271866:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+21:3313:x1875731708673920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837279.271891:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837279.271896:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3052a6 expref: 21 pid: 5839 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.271907:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3052a6 expref: 21 pid: 5839 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.271923:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f577400/0x843cbef8be3052ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3052a6 expref: 21 pid: 5839 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.271935:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837279.272031:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3313:x1875731708673920:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837279.272056:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837279.272073:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837279.272079:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708674048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837279.272155:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837279.272161:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3051db expref: 19 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.272227:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3051db expref: 19 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.272236:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f3400/0x843cbef8be3051e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3051db expref: 19 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.272246:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837279.272270:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3313:x1875731708674048:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (3375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837279.272276:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837279.272288:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837279.272294:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:3316:x1875731708674176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837279.272576:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837279.272582:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb40031800/0x843cbef8be305180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305179 expref: 17 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.272590:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb40031800/0x843cbef8be305180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305179 expref: 17 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.272600:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40031800/0x843cbef8be305180 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305179 expref: 17 pid: 5837 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.272621:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837279.272669:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3316:x1875731708674176:12345-0@lo:103:ldlm_bl.0 Request processed in 375us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837279.272675:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837279.272749:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708674176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837279.273068:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708673920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837279.273082:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708674048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837279.277913:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58746d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1875731708673408:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837279.277950:0:8513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837279.286974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837279.289505:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688724096 00000100:00100000:3.0:1788837279.289520:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688724096 00010000:00010000:3.0:1788837279.289563:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb96d expref: 10 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837279.289665:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1788837279.289677:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2361:x1875731688724096:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837279.289692:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837279.289699:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb96d expref: 10 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289712:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb96d expref: 10 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289730:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2200/0x843cbef8be30536a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb96d expref: 10 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289748:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289756:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289781:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289803:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289809:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289816:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289822:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5c00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837279.289826:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289834:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289857:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.289875:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837279.289942:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a575dfc0-4c49-4066-9796-b14a96701d37+9:2361:x1875731688724096:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 267us (2978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837279.289949:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00010000:00010000:2.0:1788837279.291218:0:8513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.291232:0:8513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837279.291256:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa5c00/0x843cbef8be30540b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837279.462192:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837279.927094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837279.927164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688724224 00000100:00100000:1.0:1788837279.927174:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688724224 00000100:00100000:1.0:1788837279.927228:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:1.0:1788837279.927239:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+9:5599:x1875731688724224:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837279.927255:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837279.927282:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb9ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837279.927340:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9ac expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837279.927368:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9ac expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837279.927388:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577c00, rc 0) 00000100:00100000:1.0:1788837279.927447:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:5599:x1875731688724224:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 210us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837279.927454:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:3.0:1788837279.931361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837279.931558:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688724352 00000100:00100000:2.0:1788837279.931568:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688724352 00000100:00100000:2.0:1788837279.931612:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:2.0:1788837279.931622:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:5599:x1875731688724352:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837279.932025:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:5599:x1875731688724352:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 403us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837279.932033:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:3.0:1788837279.935422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837279.935496:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688724480 00000100:00100000:1.0:1788837279.935507:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688724480 00000100:00100000:1.0:1788837279.935563:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:1.0:1788837279.935573:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+10:5599:x1875731688724480:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837279.935792:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+10:5599:x1875731688724480:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 219us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837279.935800:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:1.0:1788837279.940960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837279.942496:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688724608 00000100:00100000:3.0:1788837279.942508:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688724608 00000100:00100000:3.0:1788837279.942604:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:3.0:1788837279.942613:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:6148:x1875731688724608:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837279.944261:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:6148:x1875731688724608:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 1640us (3301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837279.944281:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:3.0:1788837279.957079:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837279.957146:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688724736 00000100:00100000:2.0:1788837279.957155:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688724736 00000100:00100000:2.0:1788837279.957207:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:2.0:1788837279.957218:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:6148:x1875731688724736:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837279.957482:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:6148:x1875731688724736:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 265us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837279.957491:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:2.0:1788837280.053673:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837280.053703:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837280.053738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837280.053929:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688724864 00000100:00100000:3.0:1788837280.053940:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688724864 00000100:00100000:3.0:1788837280.054012:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:3.0:1788837280.054023:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688724864:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837280.054096:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688724864:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 75us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837280.054104:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:0.0:1788837280.054428:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688724992 00000100:00100000:0.0:1788837280.054434:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688724992 00000100:00100000:0.0:1788837280.054473:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688725120 00000100:00100000:0.0:1788837280.054476:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688725120 00000100:00100000:0.0:1788837280.054498:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1788837280.054505:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688724992:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837280.054540:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688724992:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 35us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837280.054547:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1788837280.054575:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1788837280.054582:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688725120:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837280.054608:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688725120:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837280.054613:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00080000:2.0:1788837280.055050:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837280.055055:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837280.055058:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837280.486331:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837280.614487:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708674304:0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.614554:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837280.614600:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708674816:0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.614627:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837280.614652:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837280.614658:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708674688:0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.614699:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837280.614741:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708674432:0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.614883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837280.614905:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708674944:0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.614927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837280.614955:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837280.614961:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708674560:0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.614984:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837280.615192:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708674304 00000100:00100000:3.0:1788837280.615200:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708674304 00000100:00100000:3.0:1788837280.615246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788837280.615256:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3316:x1875731708674304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.615327:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3316:x1875731708674304:12345-0@lo:400:kworker.0 Request processed in 73us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837280.615334:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788837280.615366:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708674816 00000100:00100000:3.0:1788837280.615370:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708674816 00000100:00100000:3.0:1788837280.615401:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708674432 00000100:00100000:3.0:1788837280.615403:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708674432 00000100:00100000:3.0:1788837280.615415:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708674560 00000100:00100000:3.0:1788837280.615418:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708674560 00000100:00100000:3.0:1788837280.615432:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837280.615438:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708674816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.615469:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708674816:12345-0@lo:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837280.615475:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837280.615486:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837280.615491:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708674432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.615520:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708674432:12345-0@lo:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837280.615526:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837280.615537:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837280.615543:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708674560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.615579:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708674560:12345-0@lo:400:kworker.0 Request processed in 36us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837280.615585:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837280.615602:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708674688 00000100:00100000:3.0:1788837280.615605:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708674688 00000100:00100000:3.0:1788837280.615631:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708674944 00000100:00100000:3.0:1788837280.615634:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708674944 00000100:00100000:3.0:1788837280.615653:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837280.615659:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708674688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.615688:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708674688:12345-0@lo:400:kworker.0 Request processed in 29us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837280.615693:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837280.615703:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837280.615709:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708674944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.615734:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708674944:12345-0@lo:400:kworker.0 Request processed in 26us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837280.616372:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708674560:0@lo:400:kworker.0 00000100:00100000:2.0:1788837280.616390:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708674432:0@lo:400:kworker.0 00010000:00080000:2.0:1788837280.616412:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7574d180 x1875731708674944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837280.616423:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708674944:0@lo:400:kworker.0 00000100:00080000:2.0:1788837280.616456:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837280.616460:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837280.616463:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788837280.616479:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7574c700 x1875731708674688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837280.616489:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708674688:0@lo:400:kworker.0 00000100:00100000:2.0:1788837280.616497:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708674304:0@lo:400:kworker.0 00000100:00100000:2.0:1788837280.616505:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708674816:0@lo:400:kworker.0 00000100:00100000:3.0:1788837280.616572:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837280.618067:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708675072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837280.618129:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837280.618174:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708675072 00000100:00100000:0.0:1788837280.618179:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708675072 00000100:00100000:0.0:1788837280.618216:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837280.618224:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708675072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837280.618254:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837280.618292:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708675072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837280.618299:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788837280.618348:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79630000 x1875731708675072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837280.618363:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708675072:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1788837281.257996:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837281.258010:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb79181000 from 4 10000000:01000000:3.0:1788837281.258016:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837281.258074:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.258088:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.258101:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837281.258147:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837281.258233:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837281.258299:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50f9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837281.258988:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708675200 00000100:00100000:0.0:1788837281.258999:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708675200 00000100:00100000:0.0:1788837281.259068:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788837281.259079:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708675200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837281.259096:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837281.259115:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305419 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837281.259162:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305419 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837281.259175:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305419 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837281.259186:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917a400, rc 0) 00000100:00100000:0.0:1788837281.259253:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708675200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837281.259260:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788837281.259338:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837281.259359:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837281.259368:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837281.259440:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837281.259468:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837281.259492:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fe76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837281.259507:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708675328 00000100:00100000:0.0:1788837281.259510:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708675328 00000100:00100000:0.0:1788837281.259531:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788837281.259537:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708675328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837281.261491:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708675328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1942us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837281.261505:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788837281.261641:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837281.261703:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837281.261981:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837281.262058:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fe76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837281.274028:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708675456 00000100:00100000:3.0:1788837281.274048:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708675456 00000100:00100000:3.0:1788837281.274130:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788837281.274142:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708675456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837281.274490:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708675456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 350us (12508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837281.274499:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788837281.274584:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837281.274868:0:8608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8608:1875731708675584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837281.274924:0:8608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837281.274972:0:8608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50f9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837281.275145:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708675584 00000100:00100000:0.0:1788837281.275152:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708675584 00000100:00100000:0.0:1788837281.275196:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788837281.275205:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:8608:x1875731708675584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837281.275406:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:8608:x1875731708675584:12345-0@lo:502:llog_process_th.0 Request processed in 202us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837281.275414:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788837281.279084:0:8608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8608:1875731708675584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837281.279153:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837281.279171:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837281.279174:0:8608:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788837281.279181:0:8608:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb79181000 00000020:00000080:3.0:1788837281.279184:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788837281.298249:0:8608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8608:1875731708675712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837281.298378:0:8608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837281.298432:0:8608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7518c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837281.298480:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708675712 00000100:00100000:1.0:1788837281.298489:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708675712 00000100:00100000:1.0:1788837281.298544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788837281.298560:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:8608:x1875731708675712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837281.298922:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:8608:x1875731708675712:12345-0@lo:502:llog_process_th.0 Request processed in 362us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837281.298931:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788837281.299001:0:8608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8608:1875731708675712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837281.299041:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837281.299051:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837281.299053:0:8608:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788837281.299060:0:8608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788837281.299343:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788837281.299370:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837281.299382:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.299408:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837281.299420:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837281.299423:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb45cdf000 from 4 10000000:01000000:3.0:1788837281.299425:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837281.299460:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.299468:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.299479:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837281.299497:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837281.299538:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837281.299565:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fe76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837281.299582:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708675840 00000100:00100000:3.0:1788837281.299586:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708675840 00000100:00100000:3.0:1788837281.299625:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788837281.299633:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708675840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837281.299646:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837281.299660:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305427 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.299687:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305427 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.299715:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305427 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.299725:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2600, rc 0) 00000100:00100000:3.0:1788837281.299976:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708675840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 343us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837281.299982:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788837281.300022:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837281.300043:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.300052:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837281.300103:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837281.300132:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837281.300149:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268480 going to sleep for 11 seconds 00000100:00100000:3.0:1788837281.300161:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708675968 00000100:00100000:3.0:1788837281.300165:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708675968 00000100:00100000:3.0:1788837281.300185:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788837281.300191:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708675968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837281.300513:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708675968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837281.300521:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788837281.301219:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708675968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837281.301287:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708676096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837281.301690:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837281.301730:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f7320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837281.301776:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708676096 00000100:00100000:1.0:1788837281.301784:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708676096 00000100:00100000:1.0:1788837281.301829:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788837281.301838:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708676096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837281.303014:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708676096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1171us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837281.303026:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788837281.303163:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708676096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837281.303593:0:8614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8614:1875731708676224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837281.303644:0:8614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837281.303684:0:8614:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837281.303997:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708676224 00000100:00100000:2.0:1788837281.304005:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708676224 00000100:00100000:2.0:1788837281.304048:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788837281.304058:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8614:x1875731708676224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837281.304292:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8614:x1875731708676224:12345-0@lo:502:llog_process_th.0 Request processed in 235us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837281.304300:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788837281.305058:0:8614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8614:1875731708676224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837281.305103:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837281.305115:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837281.305118:0:8614:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788837281.305127:0:8614:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb45cdf000 00000020:00000080:1.0:1788837281.305130:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788837281.306800:0:8614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8614:1875731708676352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837281.307527:0:8614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837281.307588:0:8614:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837281.308108:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708676352 00000100:00100000:2.0:1788837281.308118:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708676352 00000100:00100000:2.0:1788837281.308182:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788837281.308193:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8614:x1875731708676352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837281.309192:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:8614:x1875731708676352:12345-0@lo:502:llog_process_th.0 Request processed in 994us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837281.309203:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788837281.309400:0:8614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8614:1875731708676352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837281.309444:0:8614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837281.309454:0:8614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837281.309457:0:8614:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788837281.309464:0:8614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788837281.309711:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788837281.309736:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837281.309749:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837281.309761:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837281.309774:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837281.309777:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb6a76b800 from 4 10000000:01000000:2.0:1788837281.309780:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837281.309821:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837281.309830:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837281.309841:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837281.310419:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708676480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837281.310474:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837281.310522:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837281.310549:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708676480 00000100:00100000:2.0:1788837281.310557:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708676480 00000100:00100000:2.0:1788837281.310601:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788837281.310610:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708676480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837281.310626:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837281.310643:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305435 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837281.310670:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305435 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837281.310681:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305435 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837281.310691:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4800, rc 0) 00000100:00100000:2.0:1788837281.310724:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708676480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837281.310730:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788837281.310775:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708676480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837281.310790:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837281.310801:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837281.310872:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708676608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837281.310898:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837281.314063:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837281.314983:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708676608 00000100:00100000:3.0:1788837281.314999:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708676608 00000100:00100000:3.0:1788837281.315174:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788837281.315186:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708676608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837281.315579:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708676608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 393us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837281.315588:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788837281.315664:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708676608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837281.317010:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708676736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837281.317458:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837281.317548:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837281.317593:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708676736 00000100:00100000:2.0:1788837281.317603:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708676736 00000100:00100000:2.0:1788837281.317685:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788837281.317695:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708676736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837281.318528:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708676736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 829us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837281.318538:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788837281.318639:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708676736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837281.319135:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8616:1875731708676864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837281.319191:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837281.319263:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837281.319475:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708676864 00000100:00100000:0.0:1788837281.319483:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708676864 00000100:00100000:0.0:1788837281.319521:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788837281.319530:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:8616:x1875731708676864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837281.320165:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:8616:x1875731708676864:12345-0@lo:502:llog_process_th.0 Request processed in 633us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837281.320174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788837281.320281:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8616:1875731708676864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837281.320542:0:8616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837281.320555:0:8616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837281.320558:0:8616:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788837281.320569:0:8616:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb6a76b800 00000020:00000080:0.0:1788837281.320572:0:8616:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788837281.321139:0:8616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8616:1875731708676992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837281.321213:0:8616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837281.321251:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708676992 00000100:00100000:0.0:1788837281.321258:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708676992 00000100:00100000:0.0:1788837281.321297:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788837281.321327:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:8616:x1875731708676992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837281.321544:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:8616:x1875731708676992:12345-0@lo:502:llog_process_th.0 Request processed in 219us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837281.321553:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788837281.321609:0:8616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42ac6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837281.321631:0:8616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:8616:1875731708676992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837281.321657:0:8616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837281.321663:0:8616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837281.321665:0:8616:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788837281.321671:0:8616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788837281.324089:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788837281.324142:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837281.324156:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837281.324173:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837281.515846:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837282.533566:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837282.661556:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708677120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837282.661634:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837282.661832:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708677120 00000100:00100000:0.0:1788837282.661840:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708677120 00000100:00100000:0.0:1788837282.661910:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837282.661920:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708677120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837282.661955:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837282.661999:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708677120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837282.662006:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788837282.662185:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837282.662216:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79633b80 x1875731708677120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837282.662237:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708677120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837283.557598:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837284.581877:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837285.175205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837285.175249:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837285.175281:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837285.175337:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837285.175365:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688725248 00000100:00100000:0.0:1788837285.175374:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688725248 00000100:00100000:0.0:1788837285.175415:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:0.0:1788837285.175424:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688725248:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837285.175488:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688725248:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 64us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837285.175496:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:0.0:1788837285.175526:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688725504 00000100:00100000:0.0:1788837285.175529:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688725504 00000100:00100000:0.0:1788837285.175561:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688725632 00000100:00100000:0.0:1788837285.175564:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688725632 00000100:00100000:0.0:1788837285.175583:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1788837285.175589:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688725504:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837285.175617:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688725504:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837285.175623:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1788837285.175634:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1788837285.175640:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688725632:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837285.175665:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688725632:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837285.175670:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1788837285.175687:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688725376 00000100:00100000:0.0:1788837285.175690:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688725376 00000100:00100000:0.0:1788837285.175731:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:0.0:1788837285.175745:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688725376:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837285.175773:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688725376:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837285.175779:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00080000:1.0:1788837285.176003:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837285.176008:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837285.176010:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788837285.548283:0:8812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788837285.612490:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837285.734497:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708677632:0@lo:400:kworker.0 00000100:00100000:3.0:1788837285.734562:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837285.734613:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788837285.734620:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708677248:0@lo:400:kworker.0 00000100:00100000:3.0:1788837285.734648:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837285.734670:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708677760:0@lo:400:kworker.0 00000100:00100000:3.0:1788837285.734693:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837285.734728:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708677248 00000100:00100000:3.0:1788837285.734734:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708677248 00000100:00100000:3.0:1788837285.734773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788837285.734781:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708677248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837285.734844:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708677248:12345-0@lo:400:kworker.0 Request processed in 63us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837285.734852:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788837285.734893:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708677248:0@lo:400:kworker.0 00000100:00100000:2.0:1788837285.737164:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708677760 00000100:00100000:2.0:1788837285.737178:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708677760 00000100:00100000:0.0:1788837285.737882:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708677376:0@lo:400:kworker.0 00000100:00100000:0.0:1788837285.737943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837285.737972:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708677888:0@lo:400:kworker.0 00000100:00100000:0.0:1788837285.737996:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837285.738019:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837285.738025:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708677504:0@lo:400:kworker.0 00000100:00100000:0.0:1788837285.738047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837285.738077:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708677632 00000100:00100000:0.0:1788837285.738082:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708677632 00000100:00100000:2.0:1788837285.738169:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708677376 00000100:00100000:2.0:1788837285.738173:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708677376 00000100:00100000:2.0:1788837285.738185:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708677504 00000100:00100000:2.0:1788837285.738187:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708677504 00000100:00080000:1.0:1788837285.740650:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837285.740660:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837285.740693:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837285.740715:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708677760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837285.740839:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708677760:12345-0@lo:400:kworker.0 Request processed in 134us (6143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837285.740845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837285.740869:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837285.740877:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708677376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837285.740933:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708677376:12345-0@lo:400:kworker.0 Request processed in 58us (2990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837285.740939:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837285.740992:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708677760:0@lo:400:kworker.0 00000100:00100000:0.0:1788837285.742515:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708677888 00000100:00100000:0.0:1788837285.742524:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708677888 00000100:00100000:0.0:1788837285.742567:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837285.742575:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708677888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837285.742634:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708677888:12345-0@lo:400:kworker.0 Request processed in 60us (4636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837285.742640:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837285.742669:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708678016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837285.742703:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837285.743817:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708678016 00000100:00100000:0.0:1788837285.743833:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708678016 00000100:00100000:0.0:1788837285.743867:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837285.743876:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708678016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837285.743917:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837285.744005:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708678016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837285.744013:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788837285.744451:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837285.744656:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79631880 x1875731708678016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837285.744675:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708678016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837285.744711:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708677376:0@lo:400:kworker.0 00010000:00080000:0.0:1788837285.744721:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795b3800 x1875731708677888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837285.746298:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708677888:0@lo:400:kworker.0 00000100:00100000:1.0:1788837285.755992:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837285.756009:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708677632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837285.756101:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708677632:12345-0@lo:400:kworker.0 Request processed in 98us (21539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837285.756109:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788837285.756160:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795b0a80 x1875731708677632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837285.757357:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837285.757371:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708677504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837285.757437:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708677504:12345-0@lo:400:kworker.0 Request processed in 70us (19388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837285.757444:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837285.757487:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708677504:0@lo:400:kworker.0 00000100:00100000:1.0:1788837285.759341:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708677632:0@lo:400:kworker.0 00010000:00010000:0.0:1788837286.630848:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837287.654877:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837287.782639:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837287.782668:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708678144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837287.782900:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837287.785126:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708678144 00000100:00100000:2.0:1788837287.785140:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708678144 00000100:00100000:2.0:1788837287.785268:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837287.785280:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708678144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837287.785334:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837287.785421:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708678144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837287.785428:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788837287.787581:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79631880 x1875731708678144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837287.787607:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708678144:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837287.788578:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837288.678392:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837289.702052:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837290.045874:0:9057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing yml_node 00000100:00100000:0.0:1788837290.306017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837290.306056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837290.306091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837290.306118:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688726016 00000100:00100000:0.0:1788837290.306126:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688726016 00000100:00100000:0.0:1788837290.306186:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1788837290.306196:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2357:x1875731688726016:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:0.0:1788837290.306231:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305378 00000100:00080000:0.0:1788837290.306242:0:6701:0:(import.c:65:import_set_state_nolock()) ffff9acb6a77c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837290.306278:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788837290.306616:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+2:2357:x1875731688726016:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 420us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837290.306624:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00080000:0.0:1788837290.306643:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837290.306885:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688725760 00000100:00100000:1.0:1788837290.306891:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688725760 00000100:00100000:1.0:1788837290.306965:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:1.0:1788837290.306974:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688725760:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837290.307002:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688725760:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837290.307010:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 194 00010000:00010000:1.0:1788837290.307055:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837290.308875:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688725888 00000100:00100000:2.0:1788837290.308887:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688725888 00000100:00100000:2.0:1788837290.308951:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1788837290.308962:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688725888:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837290.309025:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688725888:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 65us (2967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837290.309031:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00080000:1.0:1788837290.310027:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837290.314735:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837290.314811:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688726144 00000100:00100000:3.0:1788837290.314821:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688726144 00000100:00100000:3.0:1788837290.314885:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1788837290.314895:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2357:x1875731688726144:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:3.0:1788837290.314928:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30537f 00000100:00080000:3.0:1788837290.314939:0:6700:0:(import.c:65:import_set_state_nolock()) ffff9acb7ae2e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837290.314976:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788837290.315333:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+2:2357:x1875731688726144:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 439us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837290.315340:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00010000:00010000:3.0:1788837290.315394:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837290.315859:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788837290.725471:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837290.853540:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708678272:0@lo:400:kworker.0 00000100:00100000:1.0:1788837290.853614:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837290.853749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708678272 00000100:00100000:1.0:1788837290.853757:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708678272 00000100:00100000:1.0:1788837290.853812:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788837290.853822:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708678272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.853827:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708678400:0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.853860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837290.853869:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708678272:12345-0@lo:400:kworker.0 Request processed in 49us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837290.853876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788837290.853888:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708678400 00000100:00100000:2.0:1788837290.853891:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708678400 00000100:00100000:2.0:1788837290.853919:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788837290.853925:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708678400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837290.853938:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708678272:0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.853959:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708678400:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837290.853966:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788837290.853996:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708678400:0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.859587:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708678656:0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.859654:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837290.859690:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837290.859696:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708678784:0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.859719:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837290.859747:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708678656 00000100:00100000:2.0:1788837290.859761:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708678656 00000100:00100000:2.0:1788837290.859823:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788837290.859832:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708678656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.859878:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708678656:12345-0@lo:400:kworker.0 Request processed in 47us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837290.859884:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788837290.859910:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708678784 00000100:00100000:2.0:1788837290.859914:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708678784 00000100:00100000:2.0:1788837290.859939:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837290.859945:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708678784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.859970:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708678784:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837290.859976:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788837290.859989:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837290.859993:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837290.860007:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708678912:0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.860029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837290.860045:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837290.860049:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708678528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837290.860070:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837290.860092:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708678528 00000100:00100000:2.0:1788837290.860096:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708678528 00000100:00100000:2.0:1788837290.860125:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837290.860132:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708678528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837290.860157:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837290.860191:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708678528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837290.860206:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788837290.860223:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837290.860231:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708678912 00000100:00100000:2.0:1788837290.860234:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708678912 00000100:00100000:2.0:1788837290.860259:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788837290.860265:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708678912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.860293:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708678912:12345-0@lo:400:kworker.0 Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837290.860300:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788837290.860363:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788837290.860386:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795e9f80 x1875731708678528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837290.860403:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708678528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837290.860413:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708678912:0@lo:400:kworker.0 00010000:00080000:2.0:1788837290.860442:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795b0700 x1875731708678784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837290.860451:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708678784:0@lo:400:kworker.0 00000100:00100000:2.0:1788837290.860463:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708678656:0@lo:400:kworker.0 00010000:00010000:3.0:1788837291.752293:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837292.442329:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:2.0:1788837292.442339:0:6723:0:(genops.c:885:class_export_put()) final put ffff9acb6a77e800/4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:0.0:1788837292.442403:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb6a77e800/4c93969d-0d98-4501-b440-fa8ca1cd6478 for lustre-OST0000 00000020:00000080:0.0:1788837292.442449:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb6a77c000 for lustre-OST0000 00010000:00010000:0.0:1788837292.773511:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837292.903130:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708679040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837292.903204:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837292.903622:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708679040 00000100:00100000:2.0:1788837292.903631:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708679040 00000100:00080000:0.0:1788837292.903759:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837292.903933:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788837292.903944:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708679040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837292.903989:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837292.904049:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708679040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837292.904057:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788837292.904093:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7574d180 x1875731708679040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837292.904112:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708679040:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837293.801811:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837294.106650:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.113 00000001:00100000:2.0:1788837294.490251:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:2.0:1788837294.490259:0:7652:0:(genops.c:885:class_export_put()) final put ffff9acb7ae28800/4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:2.0:1788837294.490289:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7ae28800/4c93969d-0d98-4501-b440-fa8ca1cd6478 for lustre-OST0001 00000020:00000080:2.0:1788837294.490350:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb7ae2e000 for lustre-OST0001 00010000:00010000:0.0:1788837294.821935:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837295.416775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837295.416856:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837295.417003:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688726400 00000100:00100000:0.0:1788837295.417005:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688726272 00000100:00100000:2.0:1788837295.417014:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688726400 00000100:00100000:0.0:1788837295.417014:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688726272 00000100:00080000:1.0:1788837295.417080:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837295.417090:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:0.0:1788837295.417097:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:2.0:1788837295.417103:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688726400:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837295.417119:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688726272:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837295.417178:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688726400:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837295.417188:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1788837295.417276:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688726272:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 165us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837295.417284:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 196 00010000:00010000:0.0:1788837295.848429:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837295.973711:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708679552:0@lo:400:kworker.0 00000100:00100000:1.0:1788837295.973790:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837295.973845:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837295.973851:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708679424:0@lo:400:kworker.0 00000100:00100000:1.0:1788837295.973875:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837295.973907:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708679424 00000100:00100000:1.0:1788837295.973914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708679424 00000100:00100000:1.0:1788837295.973972:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837295.973984:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708679424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837295.973994:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708679168:0@lo:400:kworker.0 00000100:00100000:2.0:1788837295.974036:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837295.974067:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708679680:0@lo:400:kworker.0 00000100:00100000:1.0:1788837295.974074:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708679424:12345-0@lo:400:kworker.0 Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837295.974084:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788837295.974096:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837295.974105:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708679680 00000100:00100000:1.0:1788837295.974110:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708679680 00000100:00100000:2.0:1788837295.974120:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788837295.974128:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708679296:0@lo:400:kworker.0 00000100:00100000:1.0:1788837295.974159:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788837295.974167:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837295.974181:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708679808:0@lo:400:kworker.0 00000100:00100000:2.0:1788837295.974201:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837295.974245:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708679296 00000100:00100000:2.0:1788837295.974250:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708679296 00000100:00100000:2.0:1788837295.974269:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837295.974275:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708679296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837295.974335:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708679296:12345-0@lo:400:kworker.0 Request processed in 58us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837295.974343:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708679680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837295.974345:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837295.974385:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708679296:0@lo:400:kworker.0 00000100:00100000:1.0:1788837295.974392:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708679680:12345-0@lo:400:kworker.0 Request processed in 223us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837295.974401:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788837295.974404:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708679680:0@lo:400:kworker.0 00000100:00100000:2.0:1788837295.974451:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708679168 00000100:00100000:2.0:1788837295.974456:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708679168 00000100:00100000:1.0:1788837295.974485:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708679424:0@lo:400:kworker.0 00000100:00100000:2.0:1788837295.974488:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788837295.974500:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708679168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837295.974501:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837295.974516:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708679936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837295.974540:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708679168:12345-0@lo:400:kworker.0 Request processed in 42us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837295.974547:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1788837295.974573:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837295.974589:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708679168:0@lo:400:kworker.0 00000100:00100000:1.0:1788837295.974613:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837295.974648:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708679936 00000100:00100000:2.0:1788837295.974653:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708679936 00000100:00080000:1.0:1788837295.974680:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837295.974688:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837295.974697:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708679936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837295.974725:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837295.974780:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708679552 00000100:00100000:2.0:1788837295.974781:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708679936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837295.974785:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708679552 00000100:00100000:2.0:1788837295.974791:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837295.974829:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708679808 00000100:00100000:3.0:1788837295.974834:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708679808 00000100:00100000:2.0:1788837295.974838:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837295.974849:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708679552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837295.974859:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837295.974877:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708679808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837295.974891:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708679552:12345-0@lo:400:kworker.0 Request processed in 44us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837295.974898:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788837295.974930:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837295.974935:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708679808:12345-0@lo:400:kworker.0 Request processed in 59us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837295.974943:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788837295.974968:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795e8a80 x1875731708679808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837295.974979:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708679808:0@lo:400:kworker.0 00010000:00080000:1.0:1788837295.975141:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795e8380 x1875731708679936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837295.975166:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708679936:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788837295.975411:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795eb480 x1875731708679552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837295.975422:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708679552:0@lo:400:kworker.0 00000001:02000400:0.0:1788837296.730138:0:9349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.113 00010000:00010000:0.0:1788837296.875795:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837297.896084:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837298.022983:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837298.023006:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708680064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837298.023088:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837298.023636:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708680064 00000100:00100000:2.0:1788837298.023645:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708680064 00000100:00100000:2.0:1788837298.023715:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837298.023726:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708680064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837298.023772:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837298.023822:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708680064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837298.023829:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788837298.023869:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb797a8700 x1875731708680064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837298.023888:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708680064:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837298.024243:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837298.917613:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788837299.028529:0:9446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.113 00010000:00010000:0.0:1788837299.943026:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837300.538113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837300.538163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837300.538349:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688726656 00000100:00100000:2.0:1788837300.538359:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688726656 00000100:00080000:3.0:1788837300.538393:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837300.538433:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:2.0:1788837300.538444:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688726656:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837300.538514:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688726656:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 71us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837300.538528:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1788837300.538961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688726528 00000100:00100000:1.0:1788837300.538966:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688726528 00000100:00100000:1.0:1788837300.539000:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00100000:1.0:1788837300.539015:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2361:x1875731688726528:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837300.539055:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2361:x1875731688726528:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 41us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837300.539061:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 198 00000001:02000400:0.0:1788837300.648829:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 23:15:00 EDT 2026 00010000:00010000:1.0:1788837300.965588:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837301.093695:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837301.093718:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708680192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837301.093793:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837301.093877:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708680192 00000100:00100000:0.0:1788837301.093884:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708680192 00000100:00100000:0.0:1788837301.093940:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837301.093950:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708680192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837301.093986:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837301.094029:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708680192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837301.094036:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788837301.094055:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837301.094081:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795eb480 x1875731708680192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837301.094098:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708680192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837301.094730:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837301.094743:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708680320:0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.094785:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837301.094878:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708680320 00000100:00100000:1.0:1788837301.094884:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708680320 00000100:00100000:1.0:1788837301.094921:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788837301.094929:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708680320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837301.094969:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708680320:12345-0@lo:400:kworker.0 Request processed in 41us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837301.094976:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788837301.095061:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708680320:0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.095383:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708680576:0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.095415:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837301.095444:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837301.095449:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708680448:0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.095469:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837301.095493:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708680576 00000100:00100000:3.0:1788837301.095497:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708680576 00000100:00100000:3.0:1788837301.095530:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708680448 00000100:00100000:3.0:1788837301.095533:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708680448 00000100:00100000:3.0:1788837301.095548:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788837301.095555:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708680576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.095588:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708680576:12345-0@lo:400:kworker.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837301.095712:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788837301.095750:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788837301.095756:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708680448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.095785:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708680448:12345-0@lo:400:kworker.0 Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837301.095791:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788837301.095813:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837301.095832:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708680448:0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.095842:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708680576:0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.095875:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708680704:0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.095902:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837301.095923:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837301.095929:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708680832:0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.095948:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837301.095969:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708680704 00000100:00100000:3.0:1788837301.095972:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708680704 00000100:00100000:3.0:1788837301.095998:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837301.096003:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708680704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.096032:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708680704:12345-0@lo:400:kworker.0 Request processed in 29us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837301.096038:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788837301.096050:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837301.096056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708680832 00000100:00100000:3.0:1788837301.096059:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708680832 00000100:00100000:3.0:1788837301.096078:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788837301.096083:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708680832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837301.096107:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708680832:12345-0@lo:400:kworker.0 Request processed in 23us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837301.096118:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788837301.096132:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837301.096146:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708680832:0@lo:400:kworker.0 00010000:00080000:3.0:1788837301.096158:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb797aa300 x1875731708680704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837301.096167:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708680704:0@lo:400:kworker.0 00010000:00010000:0.0:1788837301.989790:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837303.018811:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837303.142104:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837303.142126:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708680960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837303.142196:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837303.142374:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708680960 00000100:00100000:3.0:1788837303.142381:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708680960 00000100:00100000:3.0:1788837303.142440:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837303.142452:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708680960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837303.142525:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837303.142580:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708680960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837303.142587:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788837303.142609:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837303.142730:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb797a9500 x1875731708680960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837303.142752:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708680960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837304.037670:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837305.063335:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837305.660498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837305.660574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837305.660762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688726912 00000100:00100000:0.0:1788837305.660772:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688726912 00000100:00100000:0.0:1788837305.660857:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:0.0:1788837305.660868:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688726912:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837305.660953:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688726912:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 86us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837305.660971:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00080000:1.0:1788837305.661954:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837305.666006:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688726784 00000100:00100000:3.0:1788837305.666022:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688726784 00000100:00100000:2.0:1788837305.668743:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 200 00000100:00100000:2.0:1788837305.668763:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:2361:x1875731688726784:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837305.668858:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:2361:x1875731688726784:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 103us (8412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837305.668866:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 200 00010000:00010000:0.0:1788837306.085512:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837306.213522:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708681216:0@lo:400:kworker.0 00000100:00100000:2.0:1788837306.213624:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837306.213673:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708681728:0@lo:400:kworker.0 00000100:00100000:2.0:1788837306.213707:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837306.213736:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837306.213742:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708681344:0@lo:400:kworker.0 00000100:00100000:2.0:1788837306.213764:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837306.213794:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708681216 00000100:00100000:2.0:1788837306.213802:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708681216 00000100:00100000:2.0:1788837306.213837:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708681344 00000100:00100000:2.0:1788837306.213839:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708681344 00000100:00100000:2.0:1788837306.213865:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837306.213873:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708681216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837306.213919:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708681216:12345-0@lo:400:kworker.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837306.213926:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837306.213941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788837306.213948:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708681344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837306.213988:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708681344:12345-0@lo:400:kworker.0 Request processed in 40us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837306.213994:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788837306.214013:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708681728 00000100:00100000:2.0:1788837306.214016:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708681728 00000100:00100000:2.0:1788837306.214042:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788837306.214048:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708681728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837306.214075:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708681728:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837306.214082:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788837306.214125:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708681344:0@lo:400:kworker.0 00000100:00100000:2.0:1788837306.214136:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708681216:0@lo:400:kworker.0 00010000:00080000:2.0:1788837306.214147:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb797ab480 x1875731708681728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837306.214172:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708681728:0@lo:400:kworker.0 00000100:00100000:3.0:1788837306.214807:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708681472:0@lo:400:kworker.0 00000100:00100000:3.0:1788837306.214843:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837306.214866:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788837306.214873:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708681088:0@lo:400:kworker.0 00000100:00100000:3.0:1788837306.214898:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837306.214930:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708681600:0@lo:400:kworker.0 00000100:00100000:3.0:1788837306.214954:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837306.214979:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708681472 00000100:00100000:3.0:1788837306.214983:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708681472 00000100:00100000:3.0:1788837306.215011:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837306.215017:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708681472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837306.215051:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708681472:12345-0@lo:400:kworker.0 Request processed in 34us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837306.215057:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837306.215088:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708681088 00000100:00100000:3.0:1788837306.215092:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708681088 00000100:00100000:3.0:1788837306.215114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788837306.215119:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708681088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837306.215144:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708681088:12345-0@lo:400:kworker.0 Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837306.215157:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788837306.215190:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708681088:0@lo:400:kworker.0 00010000:00080000:3.0:1788837306.215201:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb797ab100 x1875731708681472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837306.215210:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708681472:0@lo:400:kworker.0 00000100:00080000:1.0:1788837306.215637:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837306.215642:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837306.215645:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837306.215719:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708681600 00000100:00100000:2.0:1788837306.215724:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708681600 00000100:00100000:2.0:1788837306.215772:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788837306.215779:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708681600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837306.215821:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708681600:12345-0@lo:400:kworker.0 Request processed in 43us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837306.215828:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788837306.215856:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708681600:0@lo:400:kworker.0 00000100:00080000:1.0:1788837306.215920:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837306.217402:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708681856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837306.217469:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837306.217673:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708681856 00000100:00100000:3.0:1788837306.217680:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708681856 00000100:00100000:3.0:1788837306.217960:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837306.217970:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708681856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837306.218011:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837306.218064:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708681856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837306.218079:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788837306.218144:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795eb480 x1875731708681856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837306.218174:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708681856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788837307.117259:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837308.133578:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837308.262809:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837308.262832:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708681984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837308.262911:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837308.262977:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708681984 00000100:00100000:1.0:1788837308.262985:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708681984 00000100:00100000:1.0:1788837308.263039:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837308.263049:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708681984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837308.263082:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837308.263125:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708681984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837308.263132:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788837308.263153:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837308.263182:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795e8a80 x1875731708681984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837308.263200:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708681984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788837309.158556:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837310.181611:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837310.773715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837310.773758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837310.773817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688727040 00000100:00100000:3.0:1788837310.773826:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688727040 00000100:00100000:3.0:1788837310.773882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:3.0:1788837310.773893:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688727040:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837310.773958:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688727040:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837310.773966:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:0.0:1788837310.774025:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688727168 00000100:00100000:0.0:1788837310.774031:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688727168 00000100:00100000:0.0:1788837310.774082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:0.0:1788837310.774089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688727168:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837310.774120:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688727168:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 32us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837310.774126:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00080000:3.0:1788837310.774444:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788837311.206099:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837311.333500:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708682240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837311.333549:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708682112:0@lo:400:kworker.0 00000100:00100000:1.0:1788837311.333578:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837311.333596:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837311.335725:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708682368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837311.335838:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708682752:0@lo:400:kworker.0 00000100:00100000:1.0:1788837311.335895:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837311.335937:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708682240 00000100:00100000:1.0:1788837311.335944:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708682240 00000100:00100000:1.0:1788837311.335994:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837311.336005:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708682240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837311.336022:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708682624:0@lo:400:kworker.0 00002000:00000024:1.0:1788837311.336041:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837311.336059:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837311.336087:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837311.336095:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708682240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (2516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837311.336097:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708682496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837311.336113:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788837311.336127:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788837311.336137:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837311.336168:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708682112 00000100:00100000:2.0:1788837311.336173:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708682112 00010000:00080000:1.0:1788837311.336175:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795eaa00 x1875731708682240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837311.336196:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708682240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837311.336208:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788837311.336218:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708682112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837311.336263:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708682112:12345-0@lo:400:kworker.0 Request processed in 47us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837311.336270:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788837311.336297:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708682624 00000100:00100000:2.0:1788837311.336300:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708682624 00000100:00100000:1.0:1788837311.336357:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708682112:0@lo:400:kworker.0 00000100:00100000:0.0:1788837311.336439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708682752 00000100:00100000:0.0:1788837311.336443:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708682752 00000100:00100000:3.0:1788837311.336471:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837311.336493:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708682880:0@lo:400:kworker.0 00000100:00100000:3.0:1788837311.336514:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837311.336550:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708682496 00000100:00100000:3.0:1788837311.336554:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708682496 00000100:00100000:3.0:1788837311.336583:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708682368 00000100:00100000:3.0:1788837311.336586:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708682368 00000100:00100000:3.0:1788837311.336713:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788837311.336722:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708682496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837311.336760:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708682496:12345-0@lo:400:kworker.0 Request processed in 40us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837311.336767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788837311.337035:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788837311.337042:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708682368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837311.337081:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708682368:12345-0@lo:400:kworker.0 Request processed in 39us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837311.337087:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788837311.337098:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837311.337103:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708682752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837311.337127:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708682752:12345-0@lo:400:kworker.0 Request processed in 24us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837311.337133:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788837311.337482:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837311.337508:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708682752:0@lo:400:kworker.0 00000100:00100000:1.0:1788837311.337537:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708682496:0@lo:400:kworker.0 00000100:00080000:1.0:1788837311.338339:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837311.338354:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708682880 00000100:00100000:2.0:1788837311.338361:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708682880 00000100:00100000:2.0:1788837311.338748:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788837311.338760:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708682624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837311.338842:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708682624:12345-0@lo:400:kworker.0 Request processed in 85us (2783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837311.338849:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788837311.338864:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788837311.338870:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708682880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837311.338896:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708682880:12345-0@lo:400:kworker.0 Request processed in 27us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837311.338902:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788837311.338988:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb797ab800 x1875731708682624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837311.339000:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708682624:0@lo:400:kworker.0 00000100:00100000:2.0:1788837311.339426:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708682368:0@lo:400:kworker.0 00010000:00080000:2.0:1788837311.339439:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb797a8e00 x1875731708682880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837311.339448:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708682880:0@lo:400:kworker.0 00010000:00010000:0.0:1788837312.231416:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837313.254805:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837313.381480:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837313.381503:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708683008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837313.381578:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837313.381692:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708683008 00000100:00100000:1.0:1788837313.381710:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708683008 00000100:00100000:1.0:1788837313.381774:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837313.381784:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708683008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837313.381816:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837313.381864:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708683008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837313.381871:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788837313.381925:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795eaa00 x1875731708683008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837313.381944:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708683008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788837313.382102:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837314.281928:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837315.301500:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837315.761116:0:10125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:15:15 (1788837315) === 00000100:00100000:1.0:1788837315.896808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837315.896880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837315.897064:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688727424 00000100:00100000:0.0:1788837315.897078:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688727424 00000100:00100000:0.0:1788837315.897198:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:0.0:1788837315.897211:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688727424:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837315.897342:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688727424:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 133us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837315.897351:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1788837315.897538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688727296 00000100:00100000:2.0:1788837315.897543:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688727296 00000100:00100000:2.0:1788837315.897577:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:2.0:1788837315.897585:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688727296:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837315.897617:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2359:x1875731688727296:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 34us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837315.897636:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00080000:1.0:1788837315.897925:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837316.239478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837316.239748:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688727552 00000100:00100000:2.0:1788837316.239759:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688727552 00000100:00100000:2.0:1788837316.239822:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:2.0:1788837316.239833:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+10:8148:x1875731688727552:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788837316.239850:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837316.239872:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa4600/0x843cbef8be305443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb9b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837316.239906:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa4600/0x843cbef8be305443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9b3 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837316.239919:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa4600/0x843cbef8be305443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9b3 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837316.239929:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4600, rc 0) 00000100:00100000:2.0:1788837316.239990:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+11:8148:x1875731688727552:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 159us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837316.239998:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:1.0:1788837316.242449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837316.242919:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688727680 00000100:00100000:2.0:1788837316.242933:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688727680 00000100:00100000:2.0:1788837316.243040:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:2.0:1788837316.243054:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+11:8148:x1875731688727680:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788837316.243822:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+11:8148:x1875731688727680:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 766us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837316.243832:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:1.0:1788837316.248027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837316.248151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688727808 00000100:00100000:3.0:1788837316.248165:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688727808 00000100:00100000:3.0:1788837316.248370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 207 00000100:00100000:3.0:1788837316.248411:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+11:8148:x1875731688727808:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788837316.248745:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+11:8148:x1875731688727808:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 335us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837316.248755:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 207 00000100:00100000:0.0:1788837316.254907:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837316.255029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688727936 00000100:00100000:3.0:1788837316.255043:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688727936 00000100:00100000:3.0:1788837316.255166:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 208 00000100:00100000:3.0:1788837316.255179:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+11:8152:x1875731688727936:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837316.255648:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+11:8152:x1875731688727936:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 470us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837316.255658:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 208 00000100:00100000:0.0:1788837316.287212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837316.287650:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688728064 00000100:00100000:1.0:1788837316.287664:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688728064 00000100:00100000:1.0:1788837316.287794:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 209 00000100:00100000:1.0:1788837316.287807:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+11:8152:x1875731688728064:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837316.288182:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+11:8152:x1875731688728064:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 377us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837316.288191:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 209 00000100:00100000:1.0:1788837316.295069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837316.295261:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688728192 00000100:00100000:3.0:1788837316.295275:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688728192 00000100:00100000:3.0:1788837316.295398:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 210 00000100:00100000:3.0:1788837316.295410:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+11:8148:x1875731688728192:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788837316.295433:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837316.295455:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb4167b600/0x843cbef8be30544a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb9dd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837316.295494:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb4167b600/0x843cbef8be30544a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9dd expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837316.295508:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb4167b600/0x843cbef8be30544a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9dd expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837316.295519:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167b600, rc 0) 00000100:00100000:3.0:1788837316.295615:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+12:8148:x1875731688728192:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 207us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837316.295634:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 210 00000100:00100000:0.0:1788837316.303649:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837316.304067:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688728320 00000100:00100000:1.0:1788837316.304081:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688728320 00000100:00100000:1.0:1788837316.304209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:1.0:1788837316.304221:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+12:8148:x1875731688728320:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788837316.304259:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788837316.304289:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788837316.304295:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788837316.304298:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788837316.304300:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788837316.307176:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+12:8148:x1875731688728320:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 2942us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837316.307194:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:3.0:1788837316.311995:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837316.312137:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688728448 00000100:00100000:2.0:1788837316.312150:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688728448 00000100:00100000:2.0:1788837316.312504:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:2.0:1788837316.312518:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+12:8148:x1875731688728448:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788837316.312550:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837316.312572:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbb9e4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837316.312611:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9e4 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837316.312635:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9e4 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837316.312646:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4400, rc 0) 00000100:00100000:2.0:1788837316.312721:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:8148:x1875731688728448:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 206us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837316.312728:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:0.0:1788837316.316341:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837316.316444:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688728576 00000100:00100000:1.0:1788837316.316457:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688728576 00000100:00100000:1.0:1788837316.316525:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00100000:1.0:1788837316.316543:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:8148:x1875731688728576:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788837316.317091:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:8148:x1875731688728576:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 546us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837316.317111:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00100000:3.0:1788837316.320031:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837316.320120:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688728704 00000100:00100000:2.0:1788837316.320132:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688728704 00000100:00100000:2.0:1788837316.320208:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:2.0:1788837316.320221:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:8148:x1875731688728704:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788837316.320944:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:8148:x1875731688728704:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 720us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837316.320955:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 214 00010000:00010000:0.0:1788837316.325851:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837316.326859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837316.326934:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688728832 00000100:00100000:1.0:1788837316.326948:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688728832 00000100:00100000:1.0:1788837316.327014:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:1.0:1788837316.327027:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:8156:x1875731688728832:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837316.327402:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:8156:x1875731688728832:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 375us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837316.327410:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:1.0:1788837316.335485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837316.335650:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688728960 00000100:00100000:2.0:1788837316.335665:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688728960 00000100:00100000:2.0:1788837316.335737:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:2.0:1788837316.335749:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:8156:x1875731688728960:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837316.336080:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:8156:x1875731688728960:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 331us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837316.336090:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:0.0:1788837316.343880:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837316.343949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837316.344042:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688729472 00000100:00100000:3.0:1788837316.344055:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688729472 00000100:00100000:3.0:1788837316.344120:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688729088 00000100:00100000:3.0:1788837316.344124:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688729088 00000100:00100000:3.0:1788837316.344148:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:3.0:1788837316.344160:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688729472:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837316.344268:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688729472:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 109us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837316.344277:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:3.0:1788837316.344298:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1788837316.344334:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875731688729088:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788837316.344360:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from df5f7be0-4e83-4658-a86b-643dd9b98bf6@192.168.203.43@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1788837316.344403:0:5845:0:(genops.c:1385:class_connect()) connect: client df5f7be0-4e83-4658-a86b-643dd9b98bf6, cookie 0x843cbef8be305458 00000004:00100000:3.0:1788837316.344443:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788837316.344800:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9acb79136800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837316.344841:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2357:x1875731688729088:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 535us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837316.344849:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1788837316.351823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837316.351920:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688729216 00000100:00100000:3.0:1788837316.351934:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688729216 00000100:00100000:3.0:1788837316.352047:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1788837316.352060:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:0:x1875731688729216:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788837316.352115:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788837316.352221:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:0:x1875731688729216:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 164us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837316.352228:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00080000:1.0:1788837316.352351:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837316.357229:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837316.357341:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688729344 00000100:00100000:3.0:1788837316.357354:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688729344 00000100:00100000:3.0:1788837316.357434:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1788837316.357446:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:8148:x1875731688729344:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788837316.357502:0:7291:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788837316.357794:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:8148:x1875731688729344:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 348us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837316.357804:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1788837316.360061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837316.360158:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688729600 00000100:00100000:3.0:1788837316.360180:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688729600 00000100:00100000:3.0:1788837316.360249:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1788837316.360261:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:8148:x1875731688729600:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788837316.360408:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:8148:x1875731688729600:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 148us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837316.360416:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1788837316.364370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837316.364417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837316.364760:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688729728 00000100:00100000:1.0:1788837316.364773:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688729728 00000100:00100000:1.0:1788837316.364828:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688729856 00000100:00100000:1.0:1788837316.364831:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688729856 00000100:00100000:1.0:1788837316.364864:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:1.0:1788837316.364873:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875731688729728:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788837316.364913:0:6701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from df5f7be0-4e83-4658-a86b-643dd9b98bf6@192.168.203.43@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1788837316.364955:0:6701:0:(genops.c:1385:class_connect()) connect: client df5f7be0-4e83-4658-a86b-643dd9b98bf6, cookie 0x843cbef8be30545f 00002000:00100000:1.0:1788837316.364970:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df5f7be0-4e83-4658-a86b-643dd9b98bf6/ffff9acb6a77c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837316.365000:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788837316.365980:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1788837316.365992:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875731688729856:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788837316.366025:0:8306:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from df5f7be0-4e83-4658-a86b-643dd9b98bf6@192.168.203.43@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:0.0:1788837316.366058:0:8306:0:(genops.c:1385:class_connect()) connect: client df5f7be0-4e83-4658-a86b-643dd9b98bf6, cookie 0x843cbef8be305466 00002000:00100000:0.0:1788837316.366089:0:8306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df5f7be0-4e83-4658-a86b-643dd9b98bf6/ffff9acb44fc8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788837316.366112:0:8306:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788837316.366441:0:8306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788837316.366487:0:8306:0:(import.c:65:import_set_state_nolock()) ffff9acb44fc9000 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1788837316.371033:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788837316.371403:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2357:x1875731688729856:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 5398us (6972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837316.371421:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1788837316.371772:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837316.372711:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688729984 00000100:00100000:0.0:1788837316.372727:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688729984 00000100:00100000:0.0:1788837316.372797:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:0.0:1788837316.372809:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:8148:x1875731688729984:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788837316.372921:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788837316.373037:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:8148:x1875731688729984:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 230us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837316.373044:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00080000:1.0:1788837316.373104:0:6701:0:(import.c:65:import_set_state_nolock()) ffff9acb6a77d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837316.373210:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2357:x1875731688729728:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 8331us (8849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837316.373222:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1788837316.453547:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837316.453585:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708683136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837316.453702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837316.453885:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708683136 00000100:00100000:1.0:1788837316.453896:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708683136 00000100:00100000:1.0:1788837316.454003:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837316.454014:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708683136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837316.454037:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837316.454144:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708683136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837316.454153:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788837316.455337:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708683264:0@lo:400:kworker.0 00000100:00100000:2.0:1788837316.455428:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788837316.455444:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795e9500 x1875731708683136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837316.455478:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708683136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837316.455548:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708683264 00000100:00100000:3.0:1788837316.455556:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708683264 00000100:00100000:3.0:1788837316.455613:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788837316.455635:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708683264:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788837316.455879:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837316.456163:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708683392:0@lo:400:kworker.0 00000100:00100000:0.0:1788837316.456213:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837316.456255:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708683392 00000100:00100000:0.0:1788837316.456261:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708683392 00000100:00100000:0.0:1788837316.456328:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837316.456338:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708683392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837316.456408:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708683392:12345-0@lo:400:kworker.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837316.456420:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837316.456844:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708683392:0@lo:400:kworker.0 00000100:00100000:3.0:1788837316.457135:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708683264:12345-0@lo:400:kworker.0 Request processed in 1496us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837316.457149:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788837316.458497:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708683264:0@lo:400:kworker.0 00000100:00100000:2.0:1788837316.458615:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708683776:0@lo:400:kworker.0 00000100:00100000:2.0:1788837316.458683:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837316.458739:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708683520:0@lo:400:kworker.0 00000100:00100000:3.0:1788837316.458804:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837316.458862:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708683776 00000100:00100000:1.0:1788837316.458870:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708683776 00000100:00100000:3.0:1788837316.458873:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837316.458885:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708683648:0@lo:400:kworker.0 00000100:00100000:1.0:1788837316.458927:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708683520 00000100:00100000:3.0:1788837316.458931:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837316.458934:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708683520 00000100:00100000:1.0:1788837316.458976:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837316.458986:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708683776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837316.459071:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708683776:12345-0@lo:400:kworker.0 Request processed in 85us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837316.459079:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837316.459105:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788837316.459113:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708683520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837316.459143:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708683520:12345-0@lo:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837316.459149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788837316.459368:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708683520:0@lo:400:kworker.0 00000100:00100000:3.0:1788837316.459405:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708683776:0@lo:400:kworker.0 00000100:00100000:2.0:1788837316.459684:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708683648 00000100:00100000:2.0:1788837316.459692:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708683648 00000100:00080000:0.0:1788837316.459710:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837316.459718:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837316.459763:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788837316.459775:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708683648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837316.459851:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708683648:12345-0@lo:400:kworker.0 Request processed in 79us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837316.459868:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788837316.459987:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795e8700 x1875731708683648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837316.459998:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708683648:0@lo:400:kworker.0 00010000:00010000:0.0:1788837317.354732:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837318.047644:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df5f7be0-4e83-4658-a86b-643dd9b98bf6 00010000:00010000:0.0:1788837318.373830:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837318.501700:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708683904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837318.501796:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837318.502015:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708683904 00000100:00100000:1.0:1788837318.502026:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708683904 00000100:00100000:1.0:1788837318.502138:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837318.502150:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708683904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837318.502197:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837318.502265:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708683904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837318.502272:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788837318.507168:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837318.507785:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795e9500 x1875731708683904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837318.507823:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708683904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837319.397480:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788837320.111913:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df5f7be0-4e83-4658-a86b-643dd9b98bf6 00000001:00100000:3.0:1788837320.119488:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df5f7be0-4e83-4658-a86b-643dd9b98bf6 00010000:00010000:0.0:1788837320.421532:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837321.445807:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837321.531048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837321.531134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837321.531164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837321.531187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837321.531251:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688730112 00000100:00100000:1.0:1788837321.531260:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688730112 00000100:00100000:1.0:1788837321.531343:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:1.0:1788837321.531353:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688730112:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837321.531429:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688730112:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837321.531436:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:1.0:1788837321.531477:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688730496 00000100:00100000:1.0:1788837321.531481:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688730496 00000100:00100000:1.0:1788837321.531522:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1788837321.531530:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688730496:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837321.531556:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688730496:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837321.531562:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00080000:1.0:1788837321.531692:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837321.532777:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837321.532814:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688730624 00000100:00100000:0.0:1788837321.532829:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688730624 00000100:00100000:0.0:1788837321.532875:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:0.0:1788837321.532884:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688730624:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837321.532930:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688730624:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837321.532938:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00080000:0.0:1788837321.533031:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837321.534911:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688730240 00000100:00100000:1.0:1788837321.534921:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688730240 00000100:00100000:1.0:1788837321.534989:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688730368 00000100:00100000:1.0:1788837321.534993:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688730368 00000100:00100000:1.0:1788837321.535018:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1788837321.535028:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688730240:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837321.535094:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688730240:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 67us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837321.535101:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1788837321.535127:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1788837321.535135:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688730368:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837321.535162:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688730368:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 29us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837321.535168:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00080000:0.0:1788837321.535731:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837321.574023:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708684160:0@lo:400:kworker.0 00000100:00100000:3.0:1788837321.574089:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708684032:0@lo:400:kworker.0 00000100:00100000:2.0:1788837321.574149:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837321.574191:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708684672:0@lo:400:kworker.0 00000100:00100000:2.0:1788837321.574210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837321.574242:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708684288:0@lo:400:kworker.0 00000100:00100000:2.0:1788837321.574271:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837321.574288:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837321.574293:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708684416:0@lo:400:kworker.0 00000100:00100000:2.0:1788837321.574326:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837321.574360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708684160 00000100:00100000:2.0:1788837321.574367:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708684160 00000100:00100000:2.0:1788837321.574404:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708684288 00000100:00100000:2.0:1788837321.574407:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708684288 00000100:00100000:3.0:1788837321.574484:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837321.574505:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708684544:0@lo:400:kworker.0 00000100:00100000:3.0:1788837321.574538:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837321.574612:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708684544 00000100:00100000:3.0:1788837321.574616:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708684544 00000100:00100000:2.0:1788837321.574649:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837321.574661:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708684160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837321.574706:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708684160:12345-0@lo:400:kworker.0 Request processed in 47us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837321.574818:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788837321.574826:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708684288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837321.574859:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708684288:12345-0@lo:400:kworker.0 Request processed in 34us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837321.574865:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788837321.574880:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788837321.574885:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708684544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837321.574957:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708684544:12345-0@lo:400:kworker.0 Request processed in 71us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837321.574963:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788837321.574981:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708684032 00000100:00100000:3.0:1788837321.574985:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708684032 00000100:00100000:3.0:1788837321.575006:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788837321.575012:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708684032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837321.575040:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708684032:12345-0@lo:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837321.575045:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788837321.575070:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837321.575079:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708684800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837321.575104:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837321.575131:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708684800 00000100:00100000:3.0:1788837321.575134:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708684800 00000100:00100000:3.0:1788837321.575160:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837321.575166:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708684800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837321.575201:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837321.575235:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708684800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837321.575241:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788837321.575275:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7f553b80 x1875731708684800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837321.575292:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708684800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837321.575670:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837321.575694:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708684672 00000100:00100000:2.0:1788837321.575698:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708684672 00000100:00100000:2.0:1788837321.575720:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708684416 00000100:00100000:2.0:1788837321.575723:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708684416 00000100:00100000:2.0:1788837321.575743:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788837321.575749:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708684672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837321.575783:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708684672:12345-0@lo:400:kworker.0 Request processed in 34us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837321.575789:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788837321.575807:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788837321.575813:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708684416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837321.575842:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708684416:12345-0@lo:400:kworker.0 Request processed in 29us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837321.575847:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788837321.575872:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837321.575875:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837321.575879:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837321.575905:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708684160:0@lo:400:kworker.0 00010000:00080000:2.0:1788837321.575916:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb797aad80 x1875731708684672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837321.575926:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708684672:0@lo:400:kworker.0 00000100:00100000:1.0:1788837321.576193:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708684544:0@lo:400:kworker.0 00000100:00100000:1.0:1788837321.576211:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708684032:0@lo:400:kworker.0 00010000:00080000:3.0:1788837321.576283:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb797a9880 x1875731708684416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837321.576294:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708684416:0@lo:400:kworker.0 00000100:00100000:3.0:1788837321.576744:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708684288:0@lo:400:kworker.0 00000001:02000400:3.0:1788837321.615284:0:10321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788837322.473264:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837323.498656:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837323.623886:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708684928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837323.623954:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837323.624065:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708684928 00000100:00100000:1.0:1788837323.624073:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708684928 00000100:00100000:1.0:1788837323.624131:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788837323.624154:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708684928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837323.624188:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837323.624237:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708684928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837323.624244:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788837323.624282:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795eb480 x1875731708684928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837323.624300:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708684928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788837323.624411:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788837324.518043:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837325.544438:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837326.569628:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837326.649533:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837326.649583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837326.649614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837326.649690:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688730752 00000100:00100000:1.0:1788837326.649699:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688730752 00000100:00100000:1.0:1788837326.649743:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:1.0:1788837326.649750:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688730752:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837326.649849:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688731264 00000100:00100000:2.0:1788837326.649853:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688731264 00000100:00100000:2.0:1788837326.649892:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1788837326.649900:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688731264:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837326.649989:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688731008 00000100:00100000:3.0:1788837326.649994:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688731008 00000100:00100000:3.0:1788837326.650024:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:3.0:1788837326.650031:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688731008:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837326.651291:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688730752:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 1535us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837326.651335:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:0.0:1788837326.652245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837326.652325:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688730880 00000100:00100000:0.0:1788837326.652333:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688730880 00000100:00100000:0.0:1788837326.652386:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:0.0:1788837326.652394:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688730880:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837326.653781:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688731008:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3749us (4195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837326.653794:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00080000:3.0:1788837326.653866:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837326.653883:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837326.654587:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688730880:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 2190us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837326.654595:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:2.0:1788837326.654725:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688731264:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3730us (4014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837326.654737:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1788837326.660354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837326.660685:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688731136 00000100:00100000:2.0:1788837326.660695:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688731136 00000100:00100000:2.0:1788837326.660757:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:2.0:1788837326.660767:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688731136:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837326.660897:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688731136:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 130us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837326.660904:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00080000:3.0:1788837326.661008:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837326.693695:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708685056:0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.693771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837326.693834:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837326.693840:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708685184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837326.693865:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837326.693903:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708685312:0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.693929:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837326.693961:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708685312 00000100:00100000:2.0:1788837326.693968:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708685312 00000100:00100000:2.0:1788837326.694010:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788837326.694020:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708685312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.694068:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708685312:12345-0@lo:400:kworker.0 Request processed in 49us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837326.694076:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788837326.694116:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708685312:0@lo:400:kworker.0 00000100:00100000:1.0:1788837326.694258:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708685056 00000100:00100000:1.0:1788837326.694263:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708685056 00000100:00100000:1.0:1788837326.694321:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788837326.694330:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708685056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837326.694385:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708685056:12345-0@lo:400:kworker.0 Request processed in 57us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837326.694391:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788837326.694419:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708685184 00000100:00100000:1.0:1788837326.694423:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708685184 00000100:00080000:0.0:1788837326.694738:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837326.694801:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708685056:0@lo:400:kworker.0 00000100:00100000:1.0:1788837326.694866:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837326.694969:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708685184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837326.695000:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837326.695044:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708685184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (1176us total) trans 0 rc 0/0 00010000:00080000:2.0:1788837326.695091:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795eb480 x1875731708685184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837326.695107:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708685184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837326.695168:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708685696:0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.695224:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837326.695245:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837326.695250:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708685568:0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.695273:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837326.695294:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837326.695301:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708685440:0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.695338:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837326.695372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708685696 00000100:00100000:2.0:1788837326.695377:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708685696 00000100:00100000:2.0:1788837326.695410:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708685440 00000100:00100000:2.0:1788837326.695413:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708685440 00000100:00100000:2.0:1788837326.695433:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788837326.695439:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708685696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.695486:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708685696:12345-0@lo:400:kworker.0 Request processed in 47us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837326.695493:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788837326.695506:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788837326.695512:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708685440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.695542:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708685440:12345-0@lo:400:kworker.0 Request processed in 30us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837326.695549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788837326.695587:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708685696:0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.695608:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708685440:0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.695635:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708685568 00000100:00100000:2.0:1788837326.695638:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708685568 00000100:00100000:2.0:1788837326.695665:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837326.695678:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708685568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837326.695713:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708685568:12345-0@lo:400:kworker.0 Request processed in 36us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837326.695719:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788837326.695744:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb75194700 x1875731708685568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837326.695753:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708685568:0@lo:400:kworker.0 00000100:00080000:1.0:1788837326.696215:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837326.696220:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837326.698331:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788837327.595200:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837328.613798:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837328.742843:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837328.742865:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708685824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837328.742932:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837328.743029:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708685824 00000100:00100000:0.0:1788837328.743038:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708685824 00000100:00100000:0.0:1788837328.743108:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788837328.743119:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708685824:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788837328.743128:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788837328.743155:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837328.743217:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708685824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837328.743224:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788837328.744034:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795eb480 x1875731708685824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837328.744056:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708685824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837329.638067:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837330.661674:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837331.692219:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837331.768453:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837331.768526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688731392 00000100:00100000:3.0:1788837331.768537:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688731392 00000100:00100000:1.0:1788837331.768571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837331.768603:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:3.0:1788837331.768616:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688731392:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837331.768652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837331.768694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837331.768728:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688731392:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 115us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837331.768735:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:0.0:1788837331.768788:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688731904 00000100:00100000:0.0:1788837331.768792:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688731904 00000100:00100000:0.0:1788837331.768857:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:0.0:1788837331.768864:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688731904:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837331.768893:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688731904:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 29us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837331.768899:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00080000:3.0:1788837331.769178:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837331.769658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688731648 00000100:00100000:2.0:1788837331.769664:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688731648 00000100:00100000:3.0:1788837331.769669:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688731520 00000100:00100000:3.0:1788837331.769672:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688731520 00000100:00100000:2.0:1788837331.769715:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:2.0:1788837331.769724:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688731648:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837331.769735:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:3.0:1788837331.769741:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688731520:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:0.0:1788837331.769766:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837331.769857:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688731520:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 114us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837331.769857:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688731648:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 133us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837331.769865:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:2.0:1788837331.769869:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:1.0:1788837331.769936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837331.770174:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688731776 00000100:00100000:2.0:1788837331.770178:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688731776 00000100:00100000:2.0:1788837331.770227:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1788837331.770235:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688731776:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837331.770275:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688731776:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 41us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837331.770282:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00080000:0.0:1788837331.770287:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837331.813992:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708685952:0@lo:400:kworker.0 00000100:00100000:0.0:1788837331.814074:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837331.814124:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708686464:0@lo:400:kworker.0 00000100:00100000:0.0:1788837331.814152:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837331.814195:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708685952 00000100:00100000:0.0:1788837331.814202:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708685952 00000100:00100000:0.0:1788837331.814246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788837331.814255:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708685952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837331.814335:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708685952:12345-0@lo:400:kworker.0 Request processed in 80us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837331.814343:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788837331.814363:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708686208:0@lo:400:kworker.0 00000100:00100000:0.0:1788837331.814381:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708686464 00000100:00100000:0.0:1788837331.814400:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708686464 00000100:00100000:3.0:1788837331.814405:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837331.814430:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708686720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837331.814457:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708686208 00000100:00100000:3.0:1788837331.814461:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837331.814463:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708686208 00000100:00100000:3.0:1788837331.814488:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788837331.814495:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708686080:0@lo:400:kworker.0 00000100:00100000:0.0:1788837331.814504:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788837331.814514:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708686464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837331.814534:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837331.814547:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708686592:0@lo:400:kworker.0 00000100:00100000:3.0:1788837331.814568:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837331.814603:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708686080 00000100:00100000:3.0:1788837331.814608:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708686080 00000100:00100000:3.0:1788837331.814632:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837331.814640:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708686208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837331.814648:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708686464:12345-0@lo:400:kworker.0 Request processed in 134us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837331.814665:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788837331.814685:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708686208:12345-0@lo:400:kworker.0 Request processed in 45us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837331.814686:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788837331.814697:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788837331.814707:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708686080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837331.814734:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708686208:0@lo:400:kworker.0 00000100:00100000:0.0:1788837331.814748:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708686080:12345-0@lo:400:kworker.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837331.814759:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708686080:0@lo:400:kworker.0 00000100:00100000:2.0:1788837331.814846:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708686336:0@lo:400:kworker.0 00000100:00100000:2.0:1788837331.814877:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837331.815208:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708686720 00000100:00100000:1.0:1788837331.815232:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708686720 00000100:00100000:1.0:1788837331.815266:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788837331.815273:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708686720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837331.815301:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837331.815365:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708686720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837331.815372:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788837331.815390:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837331.815394:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837331.815413:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708685952:0@lo:400:kworker.0 00000100:00100000:1.0:1788837331.815424:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708686464:0@lo:400:kworker.0 00010000:00080000:1.0:1788837331.815451:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7f550a80 x1875731708686720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837331.815465:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708686720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837331.815491:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708686592 00000100:00100000:1.0:1788837331.815494:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708686592 00000100:00100000:1.0:1788837331.815524:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708686336 00000100:00100000:1.0:1788837331.815528:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708686336 00000100:00100000:1.0:1788837331.815555:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837331.815561:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708686592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837331.815596:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708686592:12345-0@lo:400:kworker.0 Request processed in 36us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837331.815602:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837331.815613:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837331.815619:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708686336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837331.815649:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708686336:12345-0@lo:400:kworker.0 Request processed in 30us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837331.815662:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788837331.815684:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837331.815702:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb75196680 x1875731708686592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837331.815710:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708686592:0@lo:400:kworker.0 00010000:00080000:2.0:1788837331.816261:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb75195500 x1875731708686336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837331.816285:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708686336:0@lo:400:kworker.0 00000100:00100000:0.0:1788837331.816843:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788837332.709488:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837333.741019:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837333.861603:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708686848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837333.861667:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837333.862045:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708686848 00000100:00100000:3.0:1788837333.862053:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708686848 00000100:00100000:3.0:1788837333.862120:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788837333.862131:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708686848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837333.862175:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837333.862221:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708686848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837333.862243:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788837333.862280:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb795ea300 x1875731708686848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837333.862298:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708686848:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788837333.862590:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837334.764451:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837335.787180:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837336.814811:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837336.888992:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837336.889030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837336.889100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837336.889332:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688732416 00000100:00100000:1.0:1788837336.889341:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688732416 00000100:00100000:1.0:1788837336.889403:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688732544 00000100:00100000:1.0:1788837336.889405:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688732544 00000100:00100000:1.0:1788837336.889428:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1788837336.889438:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2357:x1875731688732416:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:1.0:1788837336.889479:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30545f 00000100:00080000:1.0:1788837336.889496:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9acb6a77d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837336.889530:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788837336.890098:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+2:2357:x1875731688732416:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 660us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837336.890107:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1788837336.890125:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:1.0:1788837336.890133:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2357:x1875731688732544:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:1.0:1788837336.890148:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305466 00000100:00080000:1.0:1788837336.890153:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9acb44fc9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837336.890174:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788837336.890416:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+2:2357:x1875731688732544:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 283us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837336.890435:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00080000:1.0:1788837336.890458:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837336.890461:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837336.890646:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688732032 00000100:00100000:3.0:1788837336.890652:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688732032 00000100:00100000:3.0:1788837336.890684:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:3.0:1788837336.890692:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2359:x1875731688732032:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837336.890735:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2359:x1875731688732032:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 44us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837336.890741:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 224 00010000:00010000:0.0:1788837336.890848:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837336.890973:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837336.891540:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837336.891604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837336.891636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688732288 00000100:00100000:0.0:1788837336.891641:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688732288 00000100:00100000:0.0:1788837336.891674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688732160 00000100:00100000:0.0:1788837336.891677:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688732160 00000100:00100000:0.0:1788837336.891698:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:0.0:1788837336.891705:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2359:x1875731688732288:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837336.891757:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2359:x1875731688732288:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837336.891763:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:0.0:1788837336.891776:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:0.0:1788837336.891781:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688732160:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837336.891801:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688732160:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 21us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837336.891806:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00080000:1.0:1788837336.892128:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837336.934977:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837336.934998:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708686976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837336.935064:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837336.935237:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708687360:0@lo:400:kworker.0 00000100:00100000:3.0:1788837336.935266:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837336.935284:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837336.935289:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708687488:0@lo:400:kworker.0 00000100:00100000:3.0:1788837336.935336:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837336.935360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708687360 00000100:00100000:3.0:1788837336.935367:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708687360 00000100:00100000:3.0:1788837336.935412:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788837336.935420:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708687360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837336.935466:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708687360:12345-0@lo:400:kworker.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837336.935473:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788837336.935524:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708687360:0@lo:400:kworker.0 00000100:00100000:1.0:1788837336.935666:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708686976 00000100:00100000:1.0:1788837336.935670:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708686976 00000100:00100000:1.0:1788837336.935714:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837336.935722:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708686976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837336.935747:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837336.935786:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708686976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837336.935791:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837336.935823:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708687232:0@lo:400:kworker.0 00000100:00100000:1.0:1788837336.935849:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837336.935870:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788837336.935875:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708687104:0@lo:400:kworker.0 00000100:00100000:1.0:1788837336.935900:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837336.935925:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708687616:0@lo:400:kworker.0 00000100:00100000:1.0:1788837336.935959:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837336.935990:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708687488 00000100:00100000:1.0:1788837336.935994:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708687488 00000100:00100000:1.0:1788837336.936022:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837336.936029:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb436cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708687488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837336.936061:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb436cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708687488:12345-0@lo:400:kworker.0 Request processed in 32us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837336.936066:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837336.936999:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708687232 00000100:00100000:1.0:1788837336.937005:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708687232 00000100:00100000:1.0:1788837336.937033:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708687616 00000100:00100000:1.0:1788837336.937036:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708687616 00000100:00100000:1.0:1788837336.937058:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788837336.937065:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708687232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837336.937106:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708687232:12345-0@lo:400:kworker.0 Request processed in 42us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837336.937112:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788837336.937124:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837336.937130:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708687616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837336.937153:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708687616:12345-0@lo:400:kworker.0 Request processed in 24us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837336.937159:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837336.937176:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708687104 00000100:00100000:1.0:1788837336.937179:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708687104 00010000:00080000:0.0:1788837336.938011:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7f551c00 x1875731708687488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837336.938026:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708687488:0@lo:400:kworker.0 00010000:00080000:0.0:1788837336.938038:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7f550700 x1875731708686976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837336.938053:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708686976:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788837336.938078:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837336.938082:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837336.938086:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837336.938121:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708687616:0@lo:400:kworker.0 00000100:00100000:0.0:1788837336.938146:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708687232:0@lo:400:kworker.0 00000100:00100000:1.0:1788837336.938402:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788837336.938413:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708687104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837336.938463:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708687104:12345-0@lo:400:kworker.0 Request processed in 53us (2562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837336.938469:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788837336.938540:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708687104:0@lo:400:kworker.0 00000001:02000400:3.0:1788837337.325674:0:11022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788837337.829905:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837338.591720:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df5f7be0-4e83-4658-a86b-643dd9b98bf6 00000020:00000080:2.0:1788837338.591734:0:6723:0:(genops.c:885:class_export_put()) final put ffff9acb6a77c000/df5f7be0-4e83-4658-a86b-643dd9b98bf6 00000020:00000080:3.0:1788837338.594484:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb6a77c000/df5f7be0-4e83-4658-a86b-643dd9b98bf6 for lustre-OST0000 00000020:00000080:3.0:1788837338.596448:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb6a77d800 for lustre-OST0000 00010000:00010000:0.0:1788837338.864430:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837338.983482:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837338.983517:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708687744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837338.983618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837338.985383:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708687744 00000100:00100000:2.0:1788837338.985396:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708687744 00000100:00100000:2.0:1788837338.985483:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788837338.985495:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708687744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837338.985532:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837338.985621:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708687744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837338.985628:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788837338.985648:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837338.988735:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7f552300 x1875731708687744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837338.988769:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708687744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837339.878113:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837340.588147:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df5f7be0-4e83-4658-a86b-643dd9b98bf6 00000020:00000080:2.0:1788837340.588156:0:7652:0:(genops.c:885:class_export_put()) final put ffff9acb44fc8800/df5f7be0-4e83-4658-a86b-643dd9b98bf6 00000020:00000080:2.0:1788837340.588681:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb44fc8800/df5f7be0-4e83-4658-a86b-643dd9b98bf6 for lustre-OST0001 00000020:00000080:2.0:1788837340.593919:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb44fc9000 for lustre-OST0001 00000020:00000080:1.0:1788837340.682037:0:11172:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3eaa2680 20000000:00000080:1.0:1788837340.682053:0:11172:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9acb7967a800 uarg=0000000000000000 20000000:01000000:1.0:1788837340.682086:0:11172:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788837340.682092:0:11172:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788837340.682097:0:11172:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788837340.682857:0:11173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788837340.683003:0:11172:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788837340.688936:0:11172:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788837340.688980:0:11172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689000:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9ac expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689009:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305419 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689016:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305427 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689022:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305435 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689028:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9e4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689035:0:11172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689075:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9e4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689089:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9e4 expref: 12 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837340.689102:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708687872:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837340.689205:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305435 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689224:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305435 expref: 18 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837340.689234:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75949c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708688000:0@lo:104: 00000100:00100000:1.0:1788837340.689274:0:11172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837340.689558:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305427 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689568:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305427 expref: 18 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837340.689577:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75949f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708688128:0@lo:104: 00000100:00100000:1.0:1788837340.689600:0:11172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837340.689620:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305419 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689627:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305419 expref: 18 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837340.689636:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708688256:0@lo:104: 00000100:00100000:1.0:1788837340.689656:0:11172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837340.689674:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9ac expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.689682:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9ac expref: 12 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837340.689691:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708688384:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837340.689725:0:11172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837340.690150:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708688000 00000100:00100000:3.0:1788837340.690157:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708688000 00000100:00100000:3.0:1788837340.690195:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708688128 00000100:00100000:3.0:1788837340.690198:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708688128 00000100:00100000:3.0:1788837340.690209:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708688256 00000100:00100000:3.0:1788837340.690211:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708688256 00000100:00100000:3.0:1788837340.690223:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837340.690232:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:11172:x1875731708688000:12345-0@lo:104: 00010000:00010000:3.0:1788837340.690244:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837340.690326:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837340.690333:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:11172:x1875731708688000:12345-0@lo:104: Request processed in 101us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837340.690340:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837340.690358:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837340.690364:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:11172:x1875731708688128:12345-0@lo:104: 00010000:00010000:3.0:1788837340.690372:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837340.690412:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837340.690417:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:11172:x1875731708688128:12345-0@lo:104: Request processed in 54us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837340.690423:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837340.690436:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837340.690442:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:11172:x1875731708688256:12345-0@lo:104: 00010000:00010000:3.0:1788837340.690449:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837340.690482:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788837340.690486:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:11172:x1875731708688256:12345-0@lo:104: Request processed in 45us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837340.690491:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788837340.690772:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837340.690779:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690787:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5e00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837340.690791:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690800:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837340.690807:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837340.690813:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837340.690855:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690861:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837340.690879:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690885:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be305435 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30543c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690909:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837340.690912:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690918:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f3400 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837340.690921:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690926:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837340.690932:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837340.690936:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837340.690950:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690957:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837340.690963:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690970:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be305427 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30542e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690979:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837340.690982:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.690997:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2200 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837340.691000:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.691008:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837340.691013:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837340.691019:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837340.691032:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.691037:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837340.691053:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.691060:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb413f2200/0x843cbef8be305419 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305420 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.691073:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837340.691075:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837340.691077:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837340.691083:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837340.691094:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708688512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837340.691453:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837340.691488:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837340.691494:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708688640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837340.691589:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837340.691621:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708688768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837340.691645:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837340.691671:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708688512 00000100:00100000:0.0:1788837340.691677:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708688512 00010000:00010000:0.0:1788837340.691700:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305435 expref: 19 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837340.691716:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708688640 00000100:00100000:0.0:1788837340.691718:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708688640 00010000:00010000:0.0:1788837340.691729:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305427 expref: 20 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837340.691739:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708688768 00000100:00100000:0.0:1788837340.691742:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708688768 00010000:00010000:0.0:1788837340.691752:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305419 expref: 21 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837340.691764:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837340.691771:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+21:3315:x1875731708688512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837340.691782:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837340.691786:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305435 expref: 21 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.691796:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305435 expref: 21 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.691812:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837340.691841:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+21:3315:x1875731708688512:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837340.691857:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837340.691901:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837340.691907:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3315:x1875731708688640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837340.691915:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837340.691920:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305427 expref: 20 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.691929:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305427 expref: 20 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.691939:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837340.691960:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3315:x1875731708688640:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837340.691965:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837340.691977:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788837340.691983:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708688768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837340.691989:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837340.691993:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305419 expref: 19 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.692000:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305419 expref: 19 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.692008:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837340.692031:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708688768:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837340.692036:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788837340.692071:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708688768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837340.692106:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708688640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837340.692114:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708688512:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837340.692268:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa4800/0x843cbef8be30543c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305435 expref: 18 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837340.692280:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75949c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708688000:0@lo:104: 00010000:00010000:1.0:1788837340.692321:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2600/0x843cbef8be30542e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305427 expref: 17 pid: 5837 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837340.692329:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75949f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708688128:0@lo:104: 00010000:00010000:1.0:1788837340.692340:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7917a400/0x843cbef8be305420 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305419 expref: 16 pid: 5838 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837340.692346:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708688256:0@lo:104: 00000100:00100000:1.0:1788837340.693191:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708687872:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837340.693202:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1875731708688384:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837340.693227:0:11172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837340.696230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837340.696548:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688732672 00000100:00100000:0.0:1788837340.696549:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837340.696557:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688732672 00010000:00010000:2.0:1788837340.696598:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9e4 expref: 13 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837340.696630:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688732800 00000100:00100000:2.0:1788837340.696633:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688732800 00010000:00010000:2.0:1788837340.696645:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9ac expref: 14 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837340.696660:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:2.0:1788837340.696669:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+14:2360:x1875731688732672:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837340.696683:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837340.696688:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9e4 expref: 14 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696700:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9e4 expref: 14 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696717:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa4400/0x843cbef8be305451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9e4 expref: 14 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696731:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837340.696789:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2360:x1875731688732672:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 120us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837340.696797:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:2.0:1788837340.696814:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:2.0:1788837340.696834:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+12:2360:x1875731688732800:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837340.696842:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837340.696847:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9ac expref: 12 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696861:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9ac expref: 12 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696872:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f577c00/0x843cbef8be305412 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9ac expref: 12 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696883:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696891:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696907:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696915:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696922:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696929:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696934:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577e00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837340.696938:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696952:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696972:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837340.696983:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837340.697004:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+11:2360:x1875731688732800:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 172us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837340.697010:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00010000:00010000:1.0:1788837340.697124:0:11172:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.697132:0:11172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837340.697138:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f577e00/0x843cbef8be30546d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837340.901531:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837341.879348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837341.879522:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688732928 00000100:00100000:2.0:1788837341.879531:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688732928 00000100:00100000:2.0:1788837341.879742:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00100000:2.0:1788837341.879755:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+11:5599:x1875731688732928:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837341.879771:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837341.879790:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba0e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837341.879817:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba0e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837341.879828:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba0e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837341.879837:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4e00, rc 0) 00000100:00100000:2.0:1788837341.879893:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688732928:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 142us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837341.879912:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00100000:3.0:1788837341.884389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837341.884426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688733056 00000100:00100000:3.0:1788837341.884435:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688733056 00000100:00100000:3.0:1788837341.884490:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 227 00000100:00100000:3.0:1788837341.884501:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688733056:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837341.884777:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688733056:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 277us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837341.884785:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 227 00000100:00100000:0.0:1788837341.901528:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837341.902124:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688733184 00000100:00100000:0.0:1788837341.902134:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688733184 00000100:00100000:0.0:1788837341.902188:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 228 00000100:00100000:0.0:1788837341.902199:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688733184:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837341.903570:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688733184:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 1369us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837341.903583:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 228 00000100:00100000:0.0:1788837341.918223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837341.924195:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688733312 00000100:00100000:3.0:1788837341.924209:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688733312 00000100:00100000:3.0:1788837341.924260:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 229 00000100:00100000:3.0:1788837341.924270:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688733312:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837341.924298:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837341.924346:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba15 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837341.924528:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba15 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837341.924542:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba15 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837341.924551:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167a800, rc 0) 00000100:00100000:3.0:1788837341.924610:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688733312:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 342us (6395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837341.924617:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 229 00000100:00100000:3.0:1788837341.927146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:3.0:1788837341.929422:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837341.930144:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688733440 00000100:00100000:0.0:1788837341.930158:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688733440 00000100:00100000:0.0:1788837341.930218:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 230 00000100:00100000:0.0:1788837341.930228:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688733440:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837341.930669:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688733440:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 442us (3530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837341.930678:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 230 00000100:00100000:3.0:1788837341.932704:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837341.933021:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688733568 00000100:00100000:0.0:1788837341.933029:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688733568 00000100:00100000:0.0:1788837341.933103:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 231 00000100:00100000:0.0:1788837341.933112:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688733568:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837341.933458:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688733568:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 337us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837341.933467:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 231 00000100:00100000:3.0:1788837342.014760:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837342.014802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837342.014894:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688733824 00000100:00100000:1.0:1788837342.014924:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688733824 00000100:00100000:1.0:1788837342.014998:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688733696 00000100:00100000:1.0:1788837342.015001:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688733696 00000100:00100000:1.0:1788837342.015022:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:1.0:1788837342.015031:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2359:x1875731688733824:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837342.015099:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2359:x1875731688733824:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 69us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837342.015107:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:1.0:1788837342.015123:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:1.0:1788837342.015130:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688733696:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837342.015155:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688733696:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837342.015161:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00080000:3.0:1788837342.015636:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837342.053501:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708689024:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.053580:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837342.053646:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708689536:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.053673:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837342.053727:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837342.053735:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708689152:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.053761:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837342.053778:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708689280:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.053807:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708689024 00000100:00100000:3.0:1788837342.053816:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708689024 00000100:00100000:2.0:1788837342.053816:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837342.053844:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788837342.053852:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708688896:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.053858:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708689152 00000100:00100000:3.0:1788837342.053862:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708689152 00000100:00100000:2.0:1788837342.053882:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837342.053900:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788837342.053911:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708689024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.053963:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708689024:12345-0@lo:400:kworker.0 Request processed in 54us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837342.053970:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788837342.053985:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837342.053988:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708689408:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.053995:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708689152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.054025:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708689152:12345-0@lo:400:kworker.0 Request processed in 32us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837342.054030:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788837342.054048:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708689536 00000100:00100000:3.0:1788837342.054052:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708689536 00000100:00100000:3.0:1788837342.054076:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708689280 00000100:00100000:3.0:1788837342.054079:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708689280 00000100:00100000:2.0:1788837342.054091:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837342.054113:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788837342.054120:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708689536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.054157:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708689536:12345-0@lo:400:kworker.0 Request processed in 38us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837342.054163:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788837342.054174:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837342.054180:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708689280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.054209:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708689280:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837342.054224:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837342.054243:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708689408 00000100:00100000:3.0:1788837342.054247:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708689408 00000100:00100000:3.0:1788837342.054264:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788837342.054269:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708689408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.054298:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708689408:12345-0@lo:400:kworker.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837342.054325:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788837342.054340:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837342.054344:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837342.054346:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837342.054375:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708689408:0@lo:400:kworker.0 00010000:00080000:3.0:1788837342.054388:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7f551c00 x1875731708689280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837342.054398:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708689280:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.054431:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708689152:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.054440:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708689024:0@lo:400:kworker.0 00010000:00080000:3.0:1788837342.054460:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7f550e00 x1875731708689536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837342.054470:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708689536:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.054512:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708688896 00000100:00100000:3.0:1788837342.054515:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708688896 00000100:00100000:3.0:1788837342.054539:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788837342.054546:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3313:x1875731708688896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.055007:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3313:x1875731708688896:12345-0@lo:400:kworker.0 Request processed in 461us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837342.055014:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788837342.055108:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708688896:0@lo:400:kworker.0 00000100:00100000:3.0:1788837342.056863:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708689664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837342.056915:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837342.056942:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708689664 00000100:00100000:2.0:1788837342.056949:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708689664 00000100:00100000:3.0:1788837342.057010:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788837342.057021:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708689664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837342.057051:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837342.057085:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708689664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837342.057092:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788837342.057124:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79142a00 x1875731708689664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837342.057141:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708689664:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1788837342.629371:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837342.629378:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb79181000 from 7 10000000:01000000:3.0:1788837342.629383:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837342.629426:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837342.629438:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837342.629479:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837342.629504:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708689792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837342.629578:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837342.629622:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837342.629964:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708689792 00000100:00100000:0.0:1788837342.629972:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708689792 00000100:00100000:0.0:1788837342.630053:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788837342.630064:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708689792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837342.630077:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837342.630090:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305482 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.630123:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305482 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.630134:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305482 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.630142:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917b200, rc 0) 00000100:00100000:0.0:1788837342.630199:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708689792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837342.630205:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788837342.630283:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708689792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837342.630424:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837342.630435:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837342.630507:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75196d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708689920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837342.630538:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837342.634379:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708689920 00000100:00100000:3.0:1788837342.634395:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708689920 00000100:00100000:3.0:1788837342.634454:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788837342.634464:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708689920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837342.634853:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba480 going to sleep for 11 seconds 00000100:00100000:3.0:1788837342.634984:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708689920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 520us (4443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837342.634992:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788837342.635076:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75196d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708689920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837342.635129:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75196d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837342.635177:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837342.635194:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba480 going to sleep for 11 seconds 00000100:00100000:0.0:1788837342.635217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708690048 00000100:00100000:0.0:1788837342.635223:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708690048 00000100:00100000:1.0:1788837342.635537:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788837342.635547:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708690048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837342.641887:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708690048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6334us (6702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837342.641902:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788837342.645894:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75196d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788837342.648019:0:11250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788837342.648436:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788837342.648472:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837342.648484:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837342.648496:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837342.648507:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837342.648509:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb45cdf000 from 7 10000000:01000000:3.0:1788837342.648511:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837342.648553:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837342.648562:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837342.648573:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837342.648608:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79141180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837342.648680:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837342.650386:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837342.656354:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708690176 00000100:00100000:0.0:1788837342.656368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708690176 00000100:00100000:0.0:1788837342.656422:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788837342.656433:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708690176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837342.656458:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837342.656483:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be305490 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.656510:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be305490 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.656522:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305490 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.656530:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917a600, rc 0) 00000100:00100000:0.0:1788837342.656603:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708690176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (7923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837342.656610:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788837342.656675:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79141180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837342.656693:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.656703:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837342.656781:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.656813:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837342.656842:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca4186b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837342.656856:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708690304 00000100:00100000:0.0:1788837342.656860:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708690304 00000100:00100000:0.0:1788837342.656882:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788837342.656888:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708690304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.657113:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708690304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837342.657124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788837342.657155:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.657184:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.657235:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837342.657249:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837342.657263:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708690432 00000100:00100000:0.0:1788837342.657266:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708690432 00000100:00100000:0.0:1788837342.657287:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788837342.657294:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708690432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.657476:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708690432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837342.657487:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788837342.657526:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788837342.658165:0:11253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788837342.659095:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788837342.659119:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837342.659130:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.659143:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837342.659154:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788837342.659158:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb6a76b800 from 7 10000000:01000000:0.0:1788837342.659161:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837342.659194:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.659279:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.659290:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837342.659387:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837342.659514:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837342.659588:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837342.662105:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708690560 00000100:00100000:0.0:1788837342.662120:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708690560 00000100:00100000:0.0:1788837342.662180:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788837342.662192:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708690560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837342.662907:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837342.662930:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30549e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.662961:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30549e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.662973:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30549e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.662983:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917a400, rc 0) 00000100:00100000:0.0:1788837342.663063:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708690560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 873us (3549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837342.663072:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788837342.663138:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837342.663156:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.663175:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837342.663911:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.663957:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837342.663993:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837342.664014:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708690688 00000100:00100000:0.0:1788837342.664019:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708690688 00000100:00100000:0.0:1788837342.664064:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788837342.664074:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708690688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.665507:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708690688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1428us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837342.665519:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788837342.665577:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.665623:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.665665:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837342.665694:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837342.665711:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708690816 00000100:00100000:0.0:1788837342.665716:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708690816 00000100:00100000:0.0:1788837342.666376:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788837342.666389:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708690816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837342.666587:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708690816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837342.666594:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788837342.666661:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708690816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788837342.668978:0:11256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788837342.669903:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788837342.669929:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837342.669942:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.669955:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837342.951079:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837343.973588:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837344.103841:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837344.103863:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708690944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837344.103925:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837344.103985:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708690944 00000100:00100000:0.0:1788837344.103992:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708690944 00000100:00100000:0.0:1788837344.104059:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837344.104069:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708690944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837344.104102:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837344.104145:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708690944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837344.104151:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788837344.104170:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837344.104196:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb50dce300 x1875731708690944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837344.104213:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708690944:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788837344.156770:0:11370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788837344.998754:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837346.022645:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837347.045806:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837347.143483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837347.143553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837347.143608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837347.143655:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688734208 00000100:00100000:0.0:1788837347.143667:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688734208 00000100:00100000:1.0:1788837347.143680:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688733952 00000100:00100000:1.0:1788837347.143688:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688733952 00000100:00100000:1.0:1788837347.143754:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 242 00000100:00100000:0.0:1788837347.143757:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688734080 00000100:00100000:0.0:1788837347.143762:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688734080 00000100:00100000:1.0:1788837347.143767:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688733952:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837347.143794:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:0.0:1788837347.143805:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688734208:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837347.143878:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688734208:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 75us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837347.143887:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:0.0:1788837347.143908:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:0.0:1788837347.143915:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688734080:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837347.155811:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688733952:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 12030us (12674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837347.155830:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 242 00000100:00100000:0.0:1788837347.156114:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688734080:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 12194us (12500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837347.156126:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00080000:0.0:1788837347.156172:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837347.173544:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837347.173575:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708691072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837347.173853:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708691200:0@lo:400:kworker.0 00000100:00100000:0.0:1788837347.173897:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837347.173964:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837347.176036:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708691712:0@lo:400:kworker.0 00000100:00100000:0.0:1788837347.176118:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837347.176177:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708691712 00000100:00100000:0.0:1788837347.176179:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788837347.176188:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708691712 00000100:00100000:0.0:1788837347.176190:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708691328:0@lo:400:kworker.0 00000100:00100000:0.0:1788837347.176233:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837347.176257:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708691840:0@lo:400:kworker.0 00000100:00100000:2.0:1788837347.176258:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708691328 00000100:00100000:2.0:1788837347.176263:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708691328 00000100:00100000:2.0:1788837347.176285:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788837347.176290:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837347.176295:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708691712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837347.176354:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708691584:0@lo:400:kworker.0 00000100:00100000:2.0:1788837347.176368:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708691712:12345-0@lo:400:kworker.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837347.176375:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788837347.176389:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837347.176394:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708691328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837347.176401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837347.176435:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708691328:12345-0@lo:400:kworker.0 Request processed in 39us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837347.176442:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788837347.176443:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837347.176452:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708691456:0@lo:400:kworker.0 00000100:00100000:2.0:1788837347.176495:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708691328:0@lo:400:kworker.0 00000100:00100000:2.0:1788837347.176507:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708691712:0@lo:400:kworker.0 00000100:00100000:0.0:1788837347.177096:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837347.177146:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708691200 00000100:00100000:0.0:1788837347.177153:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708691200 00000100:00100000:0.0:1788837347.177193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788837347.177201:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708691200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837347.177245:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708691200:12345-0@lo:400:kworker.0 Request processed in 44us (3347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837347.177251:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788837347.177282:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708691072 00000100:00100000:0.0:1788837347.177287:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708691072 00000100:00100000:0.0:1788837347.177347:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837347.177355:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708691072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837347.177389:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837347.177439:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708691072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (3702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837347.177445:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837347.177542:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708691456 00000100:00100000:0.0:1788837347.177546:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708691456 00000100:00100000:0.0:1788837347.177572:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788837347.177580:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708691456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837347.177629:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708691456:12345-0@lo:400:kworker.0 Request processed in 49us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837347.177734:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708691840 00000100:00080000:1.0:1788837347.177755:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837347.177762:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837347.177831:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708691840 00000100:00100000:0.0:1788837347.177852:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788837347.177868:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708691584 00000100:00100000:3.0:1788837347.177871:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708691584 00000100:00100000:0.0:1788837347.177893:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708691456:0@lo:400:kworker.0 00000100:00100000:3.0:1788837347.177897:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788837347.177904:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708691840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837347.177942:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708691840:12345-0@lo:400:kworker.0 Request processed in 38us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837347.177948:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788837347.177960:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788837347.177965:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708691584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837347.177997:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708691584:12345-0@lo:400:kworker.0 Request processed in 32us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837347.178004:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788837347.178020:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837347.178043:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb50dcf480 x1875731708691584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837347.178055:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708691584:0@lo:400:kworker.0 00010000:00080000:1.0:1788837347.179393:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79143800 x1875731708691072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837347.179430:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708691072:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788837347.182786:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb50dcca80 x1875731708691840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837347.182812:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708691840:0@lo:400:kworker.0 00000100:00100000:3.0:1788837347.182827:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708691200:0@lo:400:kworker.0 00000001:02000400:2.0:1788837347.330197:0:11470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:15:46 (1788837346) === 00000100:00100000:3.0:1788837347.476849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837347.476927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837347.476958:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688734336 00000100:00100000:3.0:1788837347.476968:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688734336 00000100:00100000:3.0:1788837347.477021:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:3.0:1788837347.477031:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688734336:12345-192.168.203.43@tcp:41:mkdir.0 00000004:00000024:3.0:1788837347.477080:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788837347.477163:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688734336:12345-192.168.203.43@tcp:41:mkdir.0 Request processed in 133us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837347.477171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:3.0:1788837347.477909:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688734464 00000100:00100000:3.0:1788837347.477917:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688734464 00000100:00100000:3.0:1788837347.477993:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1788837347.478002:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:9702:x1875731688734464:12345-192.168.203.43@tcp:700:mkdir.0 00000100:00100000:3.0:1788837347.478239:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:9702:x1875731688734464:12345-192.168.203.43@tcp:700:mkdir.0 Request processed in 236us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837347.478248:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1788837347.486142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837347.486244:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688734720 00000100:00100000:0.0:1788837347.486253:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688734720 00000100:00100000:0.0:1788837347.486334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1788837347.486346:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:9702:x1875731688734720:12345-192.168.203.43@tcp:36:mkdir.0 00010000:00010000:0.0:1788837347.486402:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837347.486461:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be30538d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb997 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.486481:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837347.486491:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837347.486783:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.486797:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.486807:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.486835:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.486844:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.486863:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837347.487969:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788837347.487982:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.487991:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.487997:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.488003:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837347.488007:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.488014:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.488027:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:0.0:1788837347.488029:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837347.488033:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.488039:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be3054ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837347.488054:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d3f8bcf reply state 00000000b49cc085 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837347.488071:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837347.488169:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:9702:x1875731688734720:12345-192.168.203.43@tcp:36:mkdir.0 Request processed in 1823us (2034us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788837347.488178:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00010000:00010000:2.0:1788837347.490773:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.490791:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.490799:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.490806:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ba00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837347.490819:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.490828:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.490844:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9acb50df5200) 00010000:00010000:2.0:1788837347.490848:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837347.490853:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.490860:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3054b3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837347.513154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837347.513348:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688734848 00000100:00100000:1.0:1788837347.513358:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688734848 00000100:00100000:1.0:1788837347.513430:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1788837347.513442:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:9703:x1875731688734848:12345-192.168.203.43@tcp:101:chmod.0 00010000:00010000:1.0:1788837347.513463:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837347.513487:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3054ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba1c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.513551:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.513565:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.513578:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837347.513610:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788837347.513613:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837347.513648:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.513685:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3054ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba1c expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.513701:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba1c expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.513709:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631300) 00010000:00010000:1.0:1788837347.513712:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837347.513715:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577000, rc 0) 00000100:00100000:1.0:1788837347.513771:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:9703:x1875731688734848:12345-192.168.203.43@tcp:101:chmod.0 Request processed in 332us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837347.513778:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:2.0:1788837347.521501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837347.521537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688735104 00000100:00100000:2.0:1788837347.521547:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688735104 00000100:00100000:2.0:1788837347.521600:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1788837347.521610:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:9703:x1875731688735104:12345-192.168.203.43@tcp:36:chmod.0 00010000:00010000:2.0:1788837347.521661:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837347.521685:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba1c expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.521703:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631300) 00010000:00010000:2.0:1788837347.521714:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837347.521741:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.521753:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.521773:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837347.522052:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ea4a177 reply state 00000000cd42cd85 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837347.522062:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788837347.522069:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788837347.522162:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:9703:x1875731688735104:12345-192.168.203.43@tcp:36:chmod.0 Request processed in 552us (669us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788837347.522168:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00010000:00010000:3.0:1788837347.526793:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.526823:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.526830:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.526838:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837347.526842:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.526851:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.526868:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454ce100) 00010000:00010000:3.0:1788837347.526872:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788837347.526877:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.526883:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3054c8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837347.555248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837347.555447:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688735232 00000100:00100000:1.0:1788837347.555460:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688735232 00000100:00100000:1.0:1788837347.555529:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1788837347.555543:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:9704:x1875731688735232:12345-192.168.203.43@tcp:101:chown.0 00010000:00010000:1.0:1788837347.555575:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837347.555606:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3054cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.555697:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.555714:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.555727:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837347.555792:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788837347.555796:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837347.555844:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.555875:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3054cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba23 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.555896:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba23 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.555906:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631200) 00010000:00010000:1.0:1788837347.555909:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837347.555914:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577000, rc 0) 00000100:00100000:1.0:1788837347.555994:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:9704:x1875731688735232:12345-192.168.203.43@tcp:101:chown.0 Request processed in 455us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837347.556002:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1788837347.560867:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837347.561651:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688735360 00000100:00100000:2.0:1788837347.561662:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688735360 00000100:00100000:2.0:1788837347.561728:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1788837347.561739:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:9704:x1875731688735360:12345-192.168.203.43@tcp:101:chown.0 00010000:00010000:2.0:1788837347.561758:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837347.561778:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be3054dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba2a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.561840:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.561854:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.561866:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.561897:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.561905:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.561912:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564320:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5e00/0x843cbef8be3054f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564342:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5e00/0x843cbef8be3054f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564354:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5e00/0x843cbef8be3054f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837347.564460:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837347.564465:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837347.564491:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5e00/0x843cbef8be3054f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564504:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564512:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564518:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564541:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837347.564546:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564554:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564566:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631200) 00010000:00010000:2.0:1788837347.564569:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837347.564574:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564580:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be3054e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564596:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564602:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564608:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564793:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837347.564797:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564804:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564822:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9acb454ce500) 00010000:00010000:2.0:1788837347.564824:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837347.564827:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564833:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be3054eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564873:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be3054dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba2a expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564889:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5e00/0x843cbef8be3054f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba2a expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.564897:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce900) 00010000:00010000:2.0:1788837347.564899:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837347.564902:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5e00, rc 0) 00000100:00100000:2.0:1788837347.565059:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:9704:x1875731688735360:12345-192.168.203.43@tcp:101:chown.0 Request processed in 3320us (4199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837347.565069:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1788837347.571447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837347.571535:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688735616 00000100:00100000:3.0:1788837347.571545:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688735616 00000100:00100000:3.0:1788837347.571605:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1788837347.571616:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:9704:x1875731688735616:12345-192.168.203.43@tcp:36:chown.0 00010000:00010000:3.0:1788837347.571670:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837347.571697:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5e00/0x843cbef8be3054f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba2a expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.571736:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce900) 00010000:00010000:3.0:1788837347.571746:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837347.571769:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.571782:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.571792:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837347.609766:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000306caee4 reply state 000000008f4666db transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837347.609784:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788837347.609798:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788837347.609903:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:9704:x1875731688735616:12345-192.168.203.43@tcp:36:chown.0 Request processed in 38286us (38461us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788837347.609911:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000001:00080000:2.0:1788837347.610338:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1788837347.610355:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1788837347.610375:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1788837347.610446:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.610456:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.610463:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.610470:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167b800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837347.610478:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.610489:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.610506:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb4556d400) 00010000:00010000:3.0:1788837347.610510:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788837347.610517:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.610541:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3054f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837347.628520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837347.628637:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688735744 00000100:00100000:3.0:1788837347.628646:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688735744 00000100:00100000:3.0:1788837347.628699:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:3.0:1788837347.628709:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:9705:x1875731688735744:12345-192.168.203.43@tcp:101:touch.500 00010000:00010000:3.0:1788837347.628730:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837347.628750:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be305500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba31 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837347.635635:0:7291:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6835us 00010000:00010000:2.0:1788837347.647146:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647168:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647189:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647203:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647209:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647214:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647559:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647570:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647578:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837347.647600:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837347.647603:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837347.647635:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647646:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647652:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647667:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647672:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837347.647676:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647683:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647695:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631200) 00010000:00010000:2.0:1788837347.647698:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837347.647703:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647709:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4200/0x843cbef8be305507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647720:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647726:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647731:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647736:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837347.647739:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647756:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647764:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9acb454ce500) 00010000:00010000:2.0:1788837347.647767:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837347.647769:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647774:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30550e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647808:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be305500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba31 expref: 8 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647824:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba31 expref: 7 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.647832:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce000) 00010000:00010000:2.0:1788837347.647834:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788837347.647837:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5200, rc 0) 00000100:00100000:2.0:1788837347.647901:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:9705:x1875731688735744:12345-192.168.203.43@tcp:101:touch.500 Request processed in 19192us (19389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837347.647910:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1788837347.654392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837347.654523:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688736000 00000100:00100000:1.0:1788837347.654533:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688736000 00000100:00100000:1.0:1788837347.654592:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1788837347.654615:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:9705:x1875731688736000:12345-192.168.203.43@tcp:101:touch.500 00010000:00010000:1.0:1788837347.654636:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837347.654656:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30551c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba38 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.654912:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.654927:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.654938:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.655009:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.655016:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.655022:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837347.655898:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788837347.656155:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.656168:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.656177:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.656217:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.656223:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.656228:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.656234:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837347.656238:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.656244:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.656254:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce000) 00010000:00010000:1.0:1788837347.656257:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837347.656262:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.656268:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305523 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837347.656280:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079a71439 reply state 0000000023eadeca transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837347.656290:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788837347.657471:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30551c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba38 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.657512:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba38 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.657522:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9acb45631100) 00010000:00010000:1.0:1788837347.657524:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837347.657527:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576a00, rc 0) 00000100:00100000:1.0:1788837347.657609:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:9705:x1875731688736000:12345-192.168.203.43@tcp:101:touch.500 Request processed in 2996us (3226us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788837347.657617:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00010000:00010000:3.0:1788837347.663434:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.663459:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.663467:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.663474:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837347.663479:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.663491:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.663515:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff9acb45631e00) 00010000:00010000:3.0:1788837347.663532:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837347.663538:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.663544:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577a00/0x843cbef8be30552a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837347.664030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837347.664546:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688736256 00000100:00100000:2.0:1788837347.664556:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688736256 00000100:00100000:2.0:1788837347.664606:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1788837347.664616:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:9705:x1875731688736256:12345-192.168.203.43@tcp:36:touch.500 00010000:00010000:2.0:1788837347.664680:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837347.664703:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba38 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.664718:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9acb45631100) 00010000:00010000:2.0:1788837347.664726:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837347.664763:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.664776:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.664785:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837347.664905:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071ccf1cb reply state 0000000088f0189f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837347.664915:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837347.665035:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:9705:x1875731688736256:12345-192.168.203.43@tcp:36:touch.500 Request processed in 419us (1008us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788837347.665042:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00010000:00010000:3.0:1788837347.673861:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.673878:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.673886:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.673893:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837347.673898:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.673906:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.673923:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9acb454ce500) 00010000:00010000:3.0:1788837347.673926:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837347.673931:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.673937:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4800/0x843cbef8be30553f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837347.674110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837347.674178:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688736384 00000100:00100000:3.0:1788837347.674186:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688736384 00000100:00100000:3.0:1788837347.674294:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1788837347.674369:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:9705:x1875731688736384:12345-192.168.203.43@tcp:101:touch.500 00010000:00010000:3.0:1788837347.674392:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837347.674409:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be305546 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba3f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.674487:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be305546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba3f expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.674651:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be305546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba3f expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.674673:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9acb4556d400) 00010000:00010000:3.0:1788837347.674676:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837347.674679:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167b400, rc 0) 00000100:00100000:3.0:1788837347.674881:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:9705:x1875731688736384:12345-192.168.203.43@tcp:101:touch.500 Request processed in 577us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837347.674889:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1788837347.678832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837347.678922:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688736512 00000100:00100000:3.0:1788837347.678935:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688736512 00000100:00100000:3.0:1788837347.678993:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1788837347.679003:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875731688736512:12345-192.168.203.43@tcp:8:touch.500 00010000:00080000:3.0:1788837347.679043:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:3.0:1788837347.679084:0:6700:0:(genops.c:1385:class_connect()) connect: client 4c93969d-0d98-4501-b440-fa8ca1cd6478, cookie 0x843cbef8be30554d 00002000:00100000:3.0:1788837347.679099:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c93969d-0d98-4501-b440-fa8ca1cd6478/ffff9acb45de5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788837347.679130:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788837347.679877:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788837347.679925:0:6700:0:(import.c:65:import_set_state_nolock()) ffff9acb6a77d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837347.680009:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2357:x1875731688736512:12345-192.168.203.43@tcp:8:touch.500 Request processed in 1005us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837347.680019:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1788837347.682121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837347.682200:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688736640 00000100:00100000:3.0:1788837347.682210:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688736640 00000100:00100000:3.0:1788837347.682285:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1788837347.682294:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:0:x1875731688736640:12345-192.168.203.43@tcp:2:touch.500 00000100:00080000:1.0:1788837347.683200:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788837347.730564:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000001:00080000:2.0:1788837347.730585:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788837347.730753:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:0:x1875731688736640:12345-192.168.203.43@tcp:2:touch.500 Request processed in 48454us (48634us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788837347.730764:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1788837347.740995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837347.741088:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688736896 00000100:00100000:1.0:1788837347.741097:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688736896 00000100:00100000:1.0:1788837347.741146:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:1.0:1788837347.741156:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:9705:x1875731688736896:12345-192.168.203.43@tcp:35:touch.500 00000100:00100000:1.0:1788837347.741545:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:9705:x1875731688736896:12345-192.168.203.43@tcp:35:touch.500 Request processed in 390us (557us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788837347.741553:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1788837347.774959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837347.775157:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688737024 00000100:00100000:0.0:1788837347.775170:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688737024 00000100:00100000:0.0:1788837347.775354:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:0.0:1788837347.775373:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:9706:x1875731688737024:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:0.0:1788837347.775406:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837347.775445:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba46 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.775536:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30555b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.775573:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30555b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.775588:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30555b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837347.775631:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788837347.775635:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837347.775681:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30555b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.775712:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba46 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.775732:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30555b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba46 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.775741:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce000) 00010000:00010000:0.0:1788837347.775745:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837347.775749:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917ac00, rc 0) 00000100:00100000:0.0:1788837347.775843:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:9706:x1875731688737024:12345-192.168.203.43@tcp:101:rm.0 Request processed in 479us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837347.775851:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1788837347.784764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837347.785193:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688737280 00000100:00100000:1.0:1788837347.785206:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688737280 00000100:00100000:1.0:1788837347.786234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1788837347.786293:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:9706:x1875731688737280:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:1.0:1788837347.786473:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837347.786504:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba4d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837347.786626:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788837347.786850:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305562 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba4d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.786868:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631200) 00010000:00010000:1.0:1788837347.786872:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837347.786877:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba4d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.786895:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577600, rc 0) 00000100:00100000:1.0:1788837347.786988:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:9706:x1875731688737280:12345-192.168.203.43@tcp:101:rm.0 Request processed in 710us (2238us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788837347.786996:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:0.0:1788837347.798167:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837347.798993:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688737408 00000100:00100000:1.0:1788837347.799010:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688737408 00000100:00100000:1.0:1788837347.799202:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:1.0:1788837347.799216:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:9706:x1875731688737408:12345-192.168.203.43@tcp:37:rm.0 00000100:00100000:1.0:1788837347.806137:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:9706:x1875731688737408:12345-192.168.203.43@tcp:37:rm.0 Request processed in 6908us (7968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837347.806156:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1788837347.814172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837347.814355:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688737664 00000100:00100000:0.0:1788837347.814368:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688737664 00000100:00100000:0.0:1788837347.814454:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1788837347.814468:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db2f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:9706:x1875731688737664:12345-192.168.203.43@tcp:35:rm.0 00000100:00100000:0.0:1788837347.815271:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db2f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:9706:x1875731688737664:12345-192.168.203.43@tcp:35:rm.0 Request processed in 803us (1111us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788837347.815281:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1788837347.819480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837347.819828:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688737920 00000100:00100000:3.0:1788837347.819841:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688737920 00000100:00100000:3.0:1788837347.819915:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:3.0:1788837347.819928:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:9706:x1875731688737920:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:3.0:1788837347.819957:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837347.819983:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be305570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba54 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.820999:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be305577 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.821024:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be305577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.821039:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be305577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837347.821191:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788837347.824185:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be305570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba54 expref: 17 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.824677:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be305577 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba54 expref: 16 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.824691:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce000) 00010000:00010000:3.0:1788837347.824713:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788837347.824718:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2200, rc 0) 00000100:00100000:2.0:1788837347.825145:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:9706:x1875731688737920:12345-192.168.203.43@tcp:101:rm.0 Request processed in 5215us (5674us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788837347.825167:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:2.0:1788837347.833013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837347.833300:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688738048 00000100:00100000:1.0:1788837347.833380:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688738048 00000100:00100000:1.0:1788837347.833460:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:1.0:1788837347.833472:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:9706:x1875731688738048:12345-192.168.203.43@tcp:41:rm.0 00000004:00000024:1.0:1788837347.833550:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788837347.833931:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:9706:x1875731688738048:12345-192.168.203.43@tcp:41:rm.0 Request processed in 460us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837347.833940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:1.0:1788837347.841041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837347.841135:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688738176 00000100:00100000:0.0:1788837347.841148:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688738176 00000100:00100000:0.0:1788837347.841281:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1788837347.841294:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:9706:x1875731688738176:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:0.0:1788837347.841341:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837347.841368:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a200/0x843cbef8be305585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba5b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.841466:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.841484:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.841496:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.841514:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.841522:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.841529:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.841677:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30559a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.841687:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30559a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.841694:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30559a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837347.841727:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788837347.841732:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837347.845974:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30559a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846010:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30559a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846025:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846032:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846041:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846047:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917bc00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837347.846052:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846062:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846081:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce000) 00010000:00010000:1.0:1788837347.846107:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837347.846113:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846120:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be30558c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846225:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846232:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846238:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846245:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837347.846247:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846254:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846263:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff9acb50df5400) 00010000:00010000:1.0:1788837347.846266:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837347.846269:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846275:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846352:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a200/0x843cbef8be305585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba5b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846382:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30559a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba5b expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.846390:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9acb4556d400) 00010000:00010000:1.0:1788837347.846393:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837347.846395:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917ba00, rc 0) 00000100:00100000:1.0:1788837347.846578:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:9706:x1875731688738176:12345-192.168.203.43@tcp:101:rm.0 Request processed in 5285us (5548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837347.846589:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1788837347.857066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837347.857274:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688738432 00000100:00100000:3.0:1788837347.857288:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688738432 00000100:00100000:3.0:1788837347.857385:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:3.0:1788837347.857397:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:9706:x1875731688738432:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:3.0:1788837347.857482:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788837347.857518:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30559a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba5b expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.857545:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be305546 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba3f expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.857558:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9acb4556d400) 00010000:00010000:3.0:1788837347.857575:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30555b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba46 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.857583:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce000) 00010000:00010000:3.0:1788837347.857586:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837347.857614:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.857628:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.857638:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.857654:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.857680:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.857687:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.858640:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.858657:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.858667:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837347.859682:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788837347.859698:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301710392817ns, next at 302710390013ns, rc = 0 00010000:00010000:2.0:1788837347.865924:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.865960:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.865977:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.865989:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.865996:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866003:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866037:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837347.866080:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866086:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866092:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866099:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837347.866103:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866130:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866146:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9acb4556da00) 00010000:00010000:2.0:1788837347.866149:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788837347.866155:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866160:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be3055af lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.866236:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837347.866244:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.866251:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4a00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837347.866255:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866258:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.866261:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866265:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866271:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.866271:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9acb4556da00) 00010000:00010000:0.0:1788837347.866274:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788837347.866277:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f3400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837347.866278:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866281:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.866284:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3055b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866286:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837347.866294:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce000) 00010000:00010000:2.0:1788837347.866296:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837347.866299:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.866331:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837347.866334:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837347.866336:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837347.866345:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be3055a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837347.866359:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040486804 reply state 000000009fcb2784 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837347.866369:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837347.866513:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:9706:x1875731688738432:12345-192.168.203.43@tcp:36:rm.0 Request processed in 9112us (9456us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788837347.866523:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00010000:00010000:3.0:1788837347.871744:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.871767:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.871776:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.871783:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837347.871789:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.871798:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.871843:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff9acb4556d500) 00010000:00010000:3.0:1788837347.871847:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837347.871854:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.871861:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3055a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837347.872329:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837347.872453:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688738688 00000100:00100000:2.0:1788837347.872468:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688738688 00000100:00100000:2.0:1788837347.872534:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1788837347.872547:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:9706:x1875731688738688:12345-192.168.203.43@tcp:35:rm.0 00000100:00100000:2.0:1788837347.873090:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:9706:x1875731688738688:12345-192.168.203.43@tcp:35:rm.0 Request processed in 543us (783us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788837347.873100:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1788837347.883012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837347.883129:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688738944 00000100:00100000:0.0:1788837347.883141:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688738944 00000100:00100000:0.0:1788837347.883231:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:0.0:1788837347.883243:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:9706:x1875731688738944:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:0.0:1788837347.883358:0:7291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788837347.883396:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be305577 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba54 expref: 16 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.883469:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba31 expref: 15 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.883485:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb454ce000) 00010000:00010000:0.0:1788837347.883502:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3054d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba23 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.883512:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631200) 00010000:00010000:0.0:1788837347.883520:0:7291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837347.883562:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.883838:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.883851:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.883883:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.883891:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.883898:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.884725:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.884742:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837347.884751:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837347.893335:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788837347.893369:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.893382:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.893392:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.893399:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ba00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837347.893405:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.893460:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.893551:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9acb50df5600) 00010000:00010000:1.0:1788837347.893556:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788837347.893575:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.893582:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3055cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.893617:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.894585:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.894603:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.894610:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917aa00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837347.894614:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.894623:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.894644:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:1.0:1788837347.894648:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837347.894652:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837347.894658:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be3055bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837347.894680:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005e0f1c0 reply state 00000000213edf5c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837347.894711:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788837347.894846:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:9706:x1875731688738944:12345-192.168.203.43@tcp:36:rm.0 Request processed in 11599us (11843us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788837347.894857:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00010000:00010000:3.0:1788837347.899758:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.899781:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.899790:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.899797:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ac00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837347.899804:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.899814:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.899835:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9acb50df5d00) 00010000:00010000:3.0:1788837347.899839:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837347.899844:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837347.899850:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3055c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837348.069929:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837349.096260:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788837349.226727:0:7091:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303077419940ns, next at 304077417164ns, rc = 0 00000100:00100000:3.0:1788837349.226743:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837349.226765:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708691968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837349.226831:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837349.226878:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708691968 00000100:00100000:0.0:1788837349.226886:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708691968 00000100:00080000:3.0:1788837349.226913:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837349.226946:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837349.226957:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708691968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837349.226991:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837349.227044:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708691968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837349.227053:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788837349.227079:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb48ab0000 x1875731708691968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837349.227099:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708691968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837350.117640:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837351.141463:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788837351.311765:0:11619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788837352.171092:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837352.247479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837352.247555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837352.247585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837352.247617:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837352.247633:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688739200 00000100:00100000:2.0:1788837352.247641:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688739328 00000100:00100000:1.0:1788837352.247644:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688739200 00000100:00100000:2.0:1788837352.247648:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688739328 00000100:00100000:1.0:1788837352.247706:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688739456 00000100:00100000:1.0:1788837352.247710:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688739456 00000100:00100000:1.0:1788837352.250423:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:2.0:1788837352.250433:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:1.0:1788837352.250439:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:2358:x1875731688739200:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837352.250447:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2358:x1875731688739328:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837352.250526:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2358:x1875731688739328:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 84us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837352.250534:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:2.0:1788837352.250564:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:2.0:1788837352.250572:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688739456:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837352.250597:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688739456:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (2981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837352.250604:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:3.0:1788837352.250947:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688739072 00000100:00100000:3.0:1788837352.250955:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688739072 00000100:00100000:3.0:1788837352.251003:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 244 00000100:00100000:3.0:1788837352.251011:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688739072:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837352.251041:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688739072:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 31us (3571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837352.251049:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 244 00000100:00100000:1.0:1788837352.251246:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:2358:x1875731688739200:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 810us (3658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837352.251253:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00080000:1.0:1788837352.251274:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837352.251279:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837352.293600:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708692352:0@lo:400:kworker.0 00000100:00100000:0.0:1788837352.293668:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837352.293761:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708692096:0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.293801:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837352.293843:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708692608:0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.293865:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837352.293889:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837352.293895:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708692480:0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.293917:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837352.293941:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708692224:0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.293962:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837352.293984:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708692736:0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.294009:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837352.294039:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708692096 00000100:00100000:3.0:1788837352.294046:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708692096 00000100:00100000:3.0:1788837352.294084:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788837352.294093:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708692096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.294139:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708692096:12345-0@lo:400:kworker.0 Request processed in 47us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837352.294147:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788837352.294176:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708692352 00000100:00100000:3.0:1788837352.294180:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708692352 00000100:00100000:3.0:1788837352.294211:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708692608 00000100:00100000:3.0:1788837352.294215:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708692608 00000100:00100000:3.0:1788837352.294227:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708692224 00000100:00100000:3.0:1788837352.294230:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708692224 00000100:00100000:3.0:1788837352.294242:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788837352.294248:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708692352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.294279:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708692352:12345-0@lo:400:kworker.0 Request processed in 31us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837352.294285:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788837352.294297:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788837352.294339:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708692608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.294370:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708692608:12345-0@lo:400:kworker.0 Request processed in 67us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837352.294376:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788837352.294403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788837352.294410:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708692224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.294452:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708692224:12345-0@lo:400:kworker.0 Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837352.294458:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788837352.294475:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708692480 00000100:00100000:3.0:1788837352.294479:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708692480 00000100:00100000:3.0:1788837352.294504:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708692736 00000100:00100000:3.0:1788837352.294507:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708692736 00000100:00100000:3.0:1788837352.294525:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788837352.294532:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708692480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.294562:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708692480:12345-0@lo:400:kworker.0 Request processed in 31us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837352.294569:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788837352.294580:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788837352.294586:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708692736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.294614:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708692736:12345-0@lo:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837352.294620:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788837352.294642:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837352.294645:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837352.294648:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837352.294691:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708692224:0@lo:400:kworker.0 00010000:00080000:3.0:1788837352.294704:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74efc380 x1875731708692736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837352.294714:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708692736:0@lo:400:kworker.0 00010000:00080000:3.0:1788837352.294745:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb48ab0000 x1875731708692480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837352.294768:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708692480:0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.294778:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708692096:0@lo:400:kworker.0 00000100:00100000:3.0:1788837352.294787:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708692608:0@lo:400:kworker.0 00000100:00100000:1.0:1788837352.294945:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837352.294999:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708692352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837352.300249:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708692864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837352.300346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837352.303553:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708692864 00000100:00100000:0.0:1788837352.303567:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708692864 00000100:00100000:0.0:1788837352.307067:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837352.307089:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708692864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837352.307142:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837352.307234:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708692864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (6886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837352.307241:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788837352.307327:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79142680 x1875731708692864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837352.307349:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708692864:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788837352.529760:0:11667:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0a95b9c0 20000000:00000080:2.0:1788837352.529777:0:11667:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9acb7f6a6c00 uarg=0000000000000000 20000000:01000000:2.0:1788837352.529812:0:11667:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788837352.529818:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788837352.529823:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788837352.530819:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788837352.530911:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788837352.535424:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788837352.535481:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788837352.535539:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788837352.535556:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788837352.535575:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535594:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba0e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535614:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba15 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535622:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305482 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535628:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be305490 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535635:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30549e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535643:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535683:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30549e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535699:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30549e expref: 18 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837352.535712:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708692992:0@lo:104: 00000100:00100000:1.0:1788837352.535777:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837352.535841:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305490 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535850:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305490 expref: 18 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837352.535870:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75949c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708693120:0@lo:104: 00000100:00100000:1.0:1788837352.535898:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837352.535928:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be305482 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535937:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be305482 expref: 18 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837352.535945:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708693248:0@lo:104: 00000100:00100000:1.0:1788837352.535968:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837352.535987:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba15 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.535997:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba15 expref: 12 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837352.536006:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75948a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708693376:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837352.536069:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba0e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.536078:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba0e expref: 12 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837352.536087:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75949180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708693504:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837352.536108:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79169480 going to sleep for 11 seconds 00000100:00100000:0.0:1788837352.536323:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788837352.536338:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708692992 00000100:00100000:0.0:1788837352.536345:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708692992 00000100:00100000:0.0:1788837352.536389:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708693120 00000100:00100000:0.0:1788837352.536392:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708693120 00000100:00100000:0.0:1788837352.536402:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708693248 00000100:00100000:0.0:1788837352.536404:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708693248 00000100:00100000:0.0:1788837352.536416:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837352.536424:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:11667:x1875731708692992:12345-0@lo:104: 00010000:00010000:0.0:1788837352.536437:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536497:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837352.536503:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+5:11667:x1875731708692992:12345-0@lo:104: Request processed in 79us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837352.536510:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837352.536527:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837352.536533:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:11667:x1875731708693120:12345-0@lo:104: 00010000:00010000:0.0:1788837352.536540:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536567:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788837352.536572:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+4:11667:x1875731708693120:12345-0@lo:104: Request processed in 40us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837352.536577:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837352.536588:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788837352.536594:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:11667:x1875731708693248:12345-0@lo:104: 00010000:00010000:0.0:1788837352.536601:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536625:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788837352.536629:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+3:11667:x1875731708693248:12345-0@lo:104: Request processed in 37us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837352.536635:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788837352.536672:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837352.536677:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536685:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ae00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837352.536695:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536703:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837352.536710:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837352.536715:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837352.536748:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536755:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837352.536779:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837352.536786:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708693632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837352.536789:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7917ae00/0x843cbef8be30549e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3054a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536808:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837352.536812:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536818:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ae00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837352.536821:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837352.536831:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837352.536833:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837352.536851:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837352.536857:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837352.536879:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536886:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837352.536897:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536904:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167ae00/0x843cbef8be305490 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837352.536905:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788837352.536919:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788837352.536921:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708693760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837352.536924:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536932:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ac00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837352.536935:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536942:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837352.536950:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1788837352.536956:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837352.536962:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788837352.536981:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708693632 00000100:00100000:2.0:1788837352.536986:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708693632 00010000:00010000:0.0:1788837352.536990:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.536998:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837352.537015:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.537019:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30549e expref: 19 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.537027:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167ac00/0x843cbef8be305482 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be305489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.537046:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837352.537050:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708693760 00010000:00010000:0.0:1788837352.537050:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837352.537053:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837352.537056:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708693760 00010000:00010000:0.0:1788837352.537062:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837352.537078:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708693888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837352.537081:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305490 expref: 20 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837352.537102:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788837352.537112:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3313:x1875731708693632:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837352.537120:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837352.537127:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837352.537134:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30549e expref: 20 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.537148:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30549e expref: 20 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.537164:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837352.537208:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3313:x1875731708693632:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837352.537215:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788837352.537227:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708693888 00000100:00100000:2.0:1788837352.537231:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708693888 00010000:00010000:2.0:1788837352.537243:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305482 expref: 20 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837352.537254:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788837352.537259:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+20:3313:x1875731708693760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837352.537279:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837352.537282:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305490 expref: 20 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.537290:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305490 expref: 20 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.537348:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837352.537584:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7917a400/0x843cbef8be3054a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30549e expref: 20 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837352.537606:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708692992:0@lo:104: 00010000:00010000:1.0:1788837352.537620:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7917a600/0x843cbef8be305497 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305490 expref: 19 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837352.537628:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75949c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708693120:0@lo:104: 00000100:00100000:1.0:1788837352.537635:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708693248:0@lo:104: 00000100:00100000:3.0:1788837352.537858:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788837352.537868:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788837352.537939:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788837352.537948:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837352.537956:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3315:x1875731708693888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837352.537967:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837352.537972:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be305482 expref: 18 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837352.537983:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be305482 expref: 18 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837352.537995:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7917b200/0x843cbef8be305489 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be305482 expref: 18 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837352.538004:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837352.538040:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:3315:x1875731708693888:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837352.538047:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788837352.538147:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3313:x1875731708693760:12345-0@lo:103:ldlm_bl.0 Request processed in 886us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837352.538154:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837352.538571:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708693888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837352.538603:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708693760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837352.538612:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708693632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837352.541872:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75948a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708693376:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837352.541887:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75949180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875731708693504:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837352.541919:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837352.551966:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837352.552065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837352.552127:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688739584 00000100:00100000:3.0:1788837352.552137:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688739584 00000100:00100000:0.0:1788837352.552151:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688739712 00000100:00100000:0.0:1788837352.552158:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688739712 00010000:00010000:0.0:1788837352.552191:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba0e expref: 14 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837352.552192:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba15 expref: 14 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837352.552246:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:3.0:1788837352.552265:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:0.0:1788837352.552270:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+14:2358:x1875731688739712:12345-192.168.203.43@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788837352.552279:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a575dfc0-4c49-4066-9796-b14a96701d37+14:2360:x1875731688739584:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837352.552287:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837352.552296:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837352.552328:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba15 expref: 14 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.552338:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba0e expref: 14 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837352.552346:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba15 expref: 14 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.552641:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba0e expref: 14 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.552659:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa4e00/0x843cbef8be305474 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba0e expref: 14 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.552675:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837352.552764:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688739712:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 499us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837352.552772:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00010000:00010000:3.0:1788837352.556601:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb4167a800/0x843cbef8be30547b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba15 expref: 12 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837352.556628:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837352.556637:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.556931:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.556940:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.556947:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.556955:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.556962:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577600 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837352.556966:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.556974:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.560887:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.560905:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.564947:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.564966:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f577600/0x843cbef8be3055d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837352.564997:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837352.565476:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a575dfc0-4c49-4066-9796-b14a96701d37+11:2360:x1875731688739584:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 13195us (13515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837352.565487:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000004:00080000:1.0:1788837352.891207:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788837352.891236:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788837352.891263:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788837352.891576:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837352.891601:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708694016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788837352.891666:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837352.892438:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708694016 00000100:00100000:0.0:1788837352.892447:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708694016 00000100:00100000:0.0:1788837352.892539:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837352.892550:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708694016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788837352.892578:0:8306:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788837352.892612:0:8306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f7de4, atime: 0x6a9f7de4, ctime: 0x6a9f7de4, blocks: 0x1 00010000:00010000:0.0:1788837352.892621:0:8306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.892637:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=306s v=(0 0) 00010000:00010000:0.0:1788837352.892641:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837352.892647:0:8306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.892665:0:8306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.892811:0:8306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.892819:0:8306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837352.892844:0:8306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788837352.893560:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75949180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1875731708694016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1010us (1891us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788837352.893570:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788837352.893699:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837352.893706:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.893729:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ba00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837352.893733:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.893743:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.893763:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.893769:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be3055d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837352.893790:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837352.893792:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837352.893793:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788837352.894568:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb50dcd880/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788837352.894577:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708694016:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788837353.191890:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837353.589525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837353.589669:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688739840 00000100:00100000:3.0:1788837353.589680:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688739840 00000100:00100000:3.0:1788837353.589739:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 246 00000100:00100000:3.0:1788837353.589750:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+11:5599:x1875731688739840:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837353.589766:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837353.589784:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb413f2200/0x843cbef8be3055e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba62 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837353.589828:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb413f2200/0x843cbef8be3055e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba62 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837353.589839:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb413f2200/0x843cbef8be3055e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba62 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837353.589848:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2200, rc 0) 00000100:00100000:3.0:1788837353.589905:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688739840:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 157us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837353.589912:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 246 00000100:00100000:0.0:1788837353.599035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837353.603522:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688739968 00000100:00100000:3.0:1788837353.604131:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688739968 00000100:00100000:3.0:1788837353.604275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 247 00000100:00100000:3.0:1788837353.604287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688739968:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837353.605879:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688739968:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 1585us (6845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837353.605893:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 247 00000100:00100000:2.0:1788837353.612890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837353.612972:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688740096 00000100:00100000:1.0:1788837353.612983:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688740096 00000100:00100000:1.0:1788837353.613035:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 248 00000100:00100000:1.0:1788837353.613046:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688740096:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837353.613270:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688740096:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 224us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837353.613278:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 248 00000100:00100000:2.0:1788837353.636926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837353.637200:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688740224 00000100:00100000:3.0:1788837353.637211:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688740224 00000100:00100000:3.0:1788837353.637268:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 249 00000100:00100000:3.0:1788837353.637287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+12:9977:x1875731688740224:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837353.637588:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+12:9977:x1875731688740224:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 311us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837353.637597:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 249 00000100:00100000:2.0:1788837353.644693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837353.644838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688740352 00000100:00100000:0.0:1788837353.644848:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688740352 00000100:00100000:0.0:1788837353.644904:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 250 00000100:00100000:0.0:1788837353.644914:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+12:9977:x1875731688740352:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837353.645170:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+12:9977:x1875731688740352:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 256us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837353.645179:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 250 00000100:00100000:2.0:1788837353.653931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837353.654864:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688740480 00000100:00100000:1.0:1788837353.654876:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688740480 00000100:00100000:1.0:1788837353.654948:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 251 00000100:00100000:1.0:1788837353.654959:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+12:5599:x1875731688740480:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837353.654976:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837353.654994:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f577a00/0x843cbef8be3055e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba69 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837353.655023:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577a00/0x843cbef8be3055e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba69 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837353.655033:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f577a00/0x843cbef8be3055e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba69 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837353.655042:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577a00, rc 0) 00000100:00100000:1.0:1788837353.655108:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ada850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688740480:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 150us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837353.655116:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 251 00000100:00100000:2.0:1788837353.661908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837353.661976:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688740608 00000100:00100000:3.0:1788837353.661996:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688740608 00000100:00100000:3.0:1788837353.662044:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 252 00000100:00100000:3.0:1788837353.662054:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688740608:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837353.662348:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688740608:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 294us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837353.662355:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 252 00000100:00100000:2.0:1788837353.671750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837353.671871:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688740736 00000100:00100000:0.0:1788837353.671881:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688740736 00000100:00100000:0.0:1788837353.671937:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00100000:0.0:1788837353.671947:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688740736:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837353.672161:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:5599:x1875731688740736:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 214us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837353.672175:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00100000:2.0:1788837353.682102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837353.682567:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688740864 00000100:00100000:1.0:1788837353.682577:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688740864 00000100:00100000:1.0:1788837353.682620:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:1.0:1788837353.682629:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:9980:x1875731688740864:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837353.683018:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:9980:x1875731688740864:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 389us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837353.683027:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:2.0:1788837353.692474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837353.692560:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688740992 00000100:00100000:3.0:1788837353.692571:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688740992 00000100:00100000:3.0:1788837353.692626:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 255 00000100:00100000:3.0:1788837353.692636:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:9980:x1875731688740992:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837353.692890:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48adb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:9980:x1875731688740992:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 254us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837353.692898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 255 00010000:00010000:1.0:1788837354.213519:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788837354.277468:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837354.277476:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb79181000 from 7 10000000:01000000:3.0:1788837354.277481:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837354.277530:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837354.277543:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837354.277555:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837354.277579:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79142680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837354.277647:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837354.277719:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca435196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837354.277809:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708694144 00000100:00100000:0.0:1788837354.277817:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708694144 00000100:00100000:0.0:1788837354.277867:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788837354.277876:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:5841:x1875731708694144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837354.277890:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837354.277907:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7917a200/0x843cbef8be3055f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3055ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837354.277931:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7917a200/0x843cbef8be3055f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3055ee expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837354.277941:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7917a200/0x843cbef8be3055f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3055ee expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837354.277949:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917a200, rc 0) 00000100:00100000:0.0:1788837354.277996:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708694144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837354.278003:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788837354.278711:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79142680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837354.278730:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.278741:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837354.278798:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.278834:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.278866:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d83300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837354.279270:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708694272 00000100:00100000:1.0:1788837354.279275:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708694272 00000100:00100000:1.0:1788837354.279347:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788837354.279357:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708694272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837354.279630:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708694272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837354.279638:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788837354.283813:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.283882:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.283957:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.284005:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d83300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837354.284088:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708694400 00000100:00100000:3.0:1788837354.284101:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708694400 00000100:00100000:3.0:1788837354.284162:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788837354.284171:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708694400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837354.284391:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708694400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837354.284399:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788837354.284481:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.285252:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11683:1875731708694528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837354.285296:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.285380:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d83840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837354.285447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708694528 00000100:00100000:0.0:1788837354.285454:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708694528 00000100:00100000:0.0:1788837354.285488:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788837354.285497:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:11683:x1875731708694528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837354.285671:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:11683:x1875731708694528:12345-0@lo:502:llog_process_th.0 Request processed in 175us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837354.285678:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788837354.286040:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11683:1875731708694528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837354.286066:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837354.286076:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837354.286079:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788837354.286085:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9acb79181000 00000020:00000080:2.0:1788837354.286087:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837354.286168:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11683:1875731708694656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837354.286202:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.286230:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d83840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837354.292437:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708694656 00000100:00100000:3.0:1788837354.292449:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708694656 00000100:00100000:3.0:1788837354.292508:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788837354.292517:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:11683:x1875731708694656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837354.292770:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:11683:x1875731708694656:12345-0@lo:502:llog_process_th.0 Request processed in 253us (6566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837354.292778:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788837354.293133:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11683:1875731708694656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837354.293168:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837354.293177:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837354.293179:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788837354.293184:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788837354.293586:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788837354.293613:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837354.293623:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837354.293633:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837354.293643:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837354.293646:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb45cdf000 from 7 10000000:01000000:3.0:1788837354.293648:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837354.293678:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837354.293686:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837354.293702:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837354.293721:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837354.293763:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837354.293803:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43519c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837354.294115:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708694784 00000100:00100000:2.0:1788837354.294121:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708694784 00000100:00100000:2.0:1788837354.294166:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788837354.294175:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:5841:x1875731708694784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837354.294192:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837354.294204:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa4800/0x843cbef8be305603 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3055fc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.294225:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa4800/0x843cbef8be305603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3055fc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.294237:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa4800/0x843cbef8be305603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3055fc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.294246:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4800, rc 0) 00000100:00100000:2.0:1788837354.294286:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708694784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.294292:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788837354.294350:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837354.294363:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.294381:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837354.294426:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.294451:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.294467:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d83180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837354.294479:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708694912 00000100:00100000:2.0:1788837354.294483:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708694912 00000100:00100000:2.0:1788837354.294503:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788837354.294509:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708694912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.294749:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708694912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.294757:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788837354.294786:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708694912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.294811:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708695040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.294848:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.294862:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d83180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837354.294873:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708695040 00000100:00100000:2.0:1788837354.294876:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708695040 00000100:00100000:2.0:1788837354.294893:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788837354.294899:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708695040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.295029:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708695040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.295036:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788837354.295072:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708695040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.295235:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11685:1875731708695168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837354.295283:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.295321:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708695168 00000100:00100000:2.0:1788837354.295325:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708695168 00000100:00100000:2.0:1788837354.295346:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788837354.295353:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:11685:x1875731708695168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837354.295487:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:11685:x1875731708695168:12345-0@lo:502:llog_process_th.0 Request processed in 134us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.295494:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788837354.295529:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837354.295540:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11685:1875731708695168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837354.295559:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837354.295567:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837354.295569:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788837354.295575:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9acb45cdf000 00000020:00000080:2.0:1788837354.295577:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837354.295650:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11685:1875731708695296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837354.295681:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.295697:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708695296 00000100:00100000:2.0:1788837354.295700:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708695296 00000100:00100000:2.0:1788837354.295717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788837354.295721:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:11685:x1875731708695296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837354.295820:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:11685:x1875731708695296:12345-0@lo:502:llog_process_th.0 Request processed in 97us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.295825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788837354.295851:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837354.295861:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11685:1875731708695296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837354.295877:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837354.295882:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837354.295883:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788837354.295886:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788837354.295923:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788837354.295934:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837354.295941:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.295951:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837354.295967:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837354.295969:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb6a76b800 from 7 10000000:01000000:2.0:1788837354.295972:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837354.295990:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.295997:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.296005:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837354.296020:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708695424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.296046:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.296059:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d83c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837354.296070:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708695424 00000100:00100000:2.0:1788837354.296073:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708695424 00000100:00100000:2.0:1788837354.296094:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788837354.296100:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:5841:x1875731708695424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837354.296108:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837354.296119:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb46aa4200/0x843cbef8be305611 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30560a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.296139:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb46aa4200/0x843cbef8be305611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30560a expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.296150:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb46aa4200/0x843cbef8be305611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30560a expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.296169:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4200, rc 0) 00000100:00100000:2.0:1788837354.296197:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708695424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.296203:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788837354.296231:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708695424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837354.296242:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837354.296251:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837354.296287:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708695552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.296330:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.296342:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f75780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837354.296352:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708695552 00000100:00100000:2.0:1788837354.296355:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708695552 00000100:00100000:2.0:1788837354.296385:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788837354.296391:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708695552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.296559:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708695552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.296565:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788837354.296591:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708695552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.296612:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708695680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.296643:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.296660:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f75780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837354.296672:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708695680 00000100:00100000:2.0:1788837354.296675:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708695680 00000100:00100000:2.0:1788837354.296694:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788837354.296699:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708695680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.296803:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:5841:x1875731708695680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.296809:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788837354.296843:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30a8965a-c42f-4c1b-a594-94749f11bd0b:5841:1875731708695680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837354.297079:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11686:1875731708695808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837354.297114:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.297131:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708695808 00000100:00100000:2.0:1788837354.297134:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708695808 00000100:00100000:2.0:1788837354.297156:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788837354.297162:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:11686:x1875731708695808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837354.297273:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:11686:x1875731708695808:12345-0@lo:502:llog_process_th.0 Request processed in 110us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.297279:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788837354.297326:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f75780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837354.297339:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11686:1875731708695808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837354.297357:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837354.297363:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837354.297365:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788837354.311512:0:11686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9acb6a76b800 00000020:00000080:2.0:1788837354.311516:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837354.311630:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11686:1875731708695936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837354.311713:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.311746:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837354.311808:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708695936 00000100:00100000:0.0:1788837354.311823:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708695936 00000100:00100000:0.0:1788837354.311871:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788837354.311880:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:11686:x1875731708695936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837354.312079:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:11686:x1875731708695936:12345-0@lo:502:llog_process_th.0 Request processed in 199us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837354.312086:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788837354.312242:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30a8965a-c42f-4c1b-a594-94749f11bd0b:11686:1875731708695936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837354.312267:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837354.312271:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837354.312273:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788837354.312276:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788837354.312453:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788837354.312471:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837354.312480:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837354.312490:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837354.340037:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788837354.342602:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708696064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837354.342671:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837354.342746:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708696064 00000100:00100000:2.0:1788837354.342753:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708696064 00000100:00100000:2.0:1788837354.342816:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788837354.342825:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708696064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837354.342855:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837354.342893:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708696064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837354.342900:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788837354.342917:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837354.342950:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708696064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837355.238392:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837355.366040:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788837356.265350:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837357.290831:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837357.366487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837357.366521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837357.366560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837357.366598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837357.366628:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688741376 00000100:00100000:2.0:1788837357.366636:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688741376 00000100:00100000:2.0:1788837357.366694:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:2.0:1788837357.366704:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688741376:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837357.366787:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688741376:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837357.366795:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00080000:2.0:1788837357.366890:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837357.367086:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688741248 00000100:00100000:1.0:1788837357.367091:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688741248 00000100:00100000:1.0:1788837357.367139:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688741504 00000100:00100000:1.0:1788837357.367142:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688741504 00000100:00100000:3.0:1788837357.367283:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:3.0:1788837357.367299:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688741248:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:2.0:1788837357.367323:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837357.367526:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688741120 00000100:00100000:0.0:1788837357.367531:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688741120 00000100:00100000:0.0:1788837357.367564:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 271 00000100:00100000:3.0:1788837357.367570:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688741248:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 276us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837357.367576:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688741120:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837357.367607:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688741120:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 36us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837357.367615:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 271 00000100:00100000:1.0:1788837357.374224:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:1.0:1788837357.374249:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688741504:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837357.374362:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688741504:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 125us (7840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837357.374370:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:3.0:1788837357.375693:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:2.0:1788837357.413502:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837357.413515:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708696448:0@lo:400:kworker.0 00000100:00100000:2.0:1788837357.413521:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708696576:0@lo:400:kworker.0 00000100:00100000:1.0:1788837357.413597:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708696704:0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.413683:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837357.413754:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708696960:0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.413782:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837357.413806:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788837357.413812:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708696320:0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.413838:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837357.413857:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708696832:0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.413877:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837357.413907:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708696960 00000100:00100000:3.0:1788837357.413915:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708696960 00000100:00100000:3.0:1788837357.413991:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788837357.414002:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708696960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.414057:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708696960:12345-0@lo:400:kworker.0 Request processed in 57us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837357.414064:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788837357.414104:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74efdf80 x1875731708696960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837357.414118:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708696960:0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.414144:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708696448 00000100:00100000:3.0:1788837357.414148:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708696448 00000100:00100000:3.0:1788837357.414173:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708696832 00000100:00100000:3.0:1788837357.414176:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708696832 00000100:00100000:3.0:1788837357.414195:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788837357.414201:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708696448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.414619:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708696448:12345-0@lo:400:kworker.0 Request processed in 417us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837357.414627:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788837357.414643:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788837357.414650:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708696832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.414678:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708696832:12345-0@lo:400:kworker.0 Request processed in 30us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837357.414684:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788837357.414725:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708696832:0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.414735:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708696448:0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.414773:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708696320 00000100:00100000:3.0:1788837357.414785:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708696320 00000100:00100000:3.0:1788837357.414814:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788837357.414820:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708696320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.414856:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708696320:12345-0@lo:400:kworker.0 Request processed in 36us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837357.414861:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788837357.414892:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708696320:0@lo:400:kworker.0 00000100:00080000:3.0:1788837357.414912:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837357.414916:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837357.416100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837357.416335:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708696704 00000100:00100000:3.0:1788837357.416342:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708696704 00000100:00100000:3.0:1788837357.416508:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837357.416517:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875731708696704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837357.416575:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875731708696704:12345-0@lo:400:kworker.0 Request processed in 59us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837357.416583:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837357.416624:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708696704:0@lo:400:kworker.0 00000100:00080000:0.0:1788837357.418249:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837357.420228:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837357.420287:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708696192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837357.420357:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837357.420809:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708696192 00000100:00100000:1.0:1788837357.420818:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708696192 00000100:00100000:3.0:1788837357.420944:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708696576 00000100:00100000:3.0:1788837357.420950:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708696576 00000100:00100000:1.0:1788837357.420971:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788837357.420984:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708696192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837357.421012:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788837357.421023:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708696576:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788837357.421023:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837357.421084:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708696192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837357.421092:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788837357.421160:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788837357.421207:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79142d80 x1875731708696192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837357.421433:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708696192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837357.421531:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708696576:12345-0@lo:400:kworker.0 Request processed in 510us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837357.421539:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788837357.421711:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708696576:0@lo:400:kworker.0 00000001:00080000:0.0:1788837357.983545:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1788837358.310291:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837359.333954:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837359.463221:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837359.463250:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708697088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837359.463366:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837359.465194:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708697088 00000100:00100000:0.0:1788837359.465221:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708697088 00000100:00100000:0.0:1788837359.465299:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837359.465342:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708697088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837359.465380:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837359.465456:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708697088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837359.465462:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788837359.465593:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788837359.465600:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb50dcd880, transno 4294967300 00000100:00100000:2.0:1788837359.465625:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708697088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837359.465691:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837360.358432:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837361.381521:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837362.405521:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837362.489574:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837362.489617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837362.489650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837362.489743:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688741760 00000100:00100000:3.0:1788837362.489753:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688741760 00000100:00100000:3.0:1788837362.489805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688742016 00000100:00100000:3.0:1788837362.489808:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688742016 00000100:00100000:3.0:1788837362.489842:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:3.0:1788837362.489852:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688741760:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837362.489925:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688741760:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 74us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837362.489931:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:3.0:1788837362.489947:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:3.0:1788837362.489954:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688742016:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837362.489979:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688742016:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837362.489985:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00080000:3.0:1788837362.490002:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837362.490607:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837362.490838:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688741888 00000100:00100000:3.0:1788837362.490844:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688741888 00000100:00100000:3.0:1788837362.490941:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1788837362.490950:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688741888:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837362.490994:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688741888:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 45us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837362.491000:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00080000:2.0:1788837362.491122:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837362.492526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688741632 00000100:00100000:1.0:1788837362.492550:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688741632 00000100:00100000:1.0:1788837362.492852:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 273 00000100:00100000:1.0:1788837362.492863:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688741632:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837362.492925:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688741632:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 64us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837362.492933:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 273 00000100:00100000:2.0:1788837362.534247:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708697216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837362.534344:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837362.534499:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708697216 00000100:00100000:1.0:1788837362.534508:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708697216 00000100:00100000:1.0:1788837362.534626:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837362.534636:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708697216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837362.534669:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837362.534716:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708697216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837362.534723:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788837362.535128:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788837362.535159:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb79142d80 x1875731708697216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837362.535177:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708697216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837362.535527:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708697344:0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.535567:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837362.535601:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708697856:0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.535627:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837362.535649:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837362.535655:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708697472:0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.535676:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837362.535700:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708697856 00000100:00100000:0.0:1788837362.535705:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708697856 00000100:00100000:0.0:1788837362.535741:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708697472 00000100:00100000:0.0:1788837362.535744:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708697472 00000100:00100000:0.0:1788837362.535761:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837362.535768:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708697856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.535806:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708697856:12345-0@lo:400:kworker.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837362.535813:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837362.535838:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788837362.535845:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708697472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.535871:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708697472:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837362.535887:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788837362.535910:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708697600:0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.535936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837362.535953:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837362.535958:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708697728:0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.535980:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837362.536003:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708697728 00000100:00100000:0.0:1788837362.536006:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708697728 00000100:00100000:0.0:1788837362.536033:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788837362.536041:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708697728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.536072:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708697728:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837362.536078:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788837362.536125:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708697728:0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.536149:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708697472:0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.536158:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708697856:0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.536174:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708697600 00000100:00100000:0.0:1788837362.536177:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708697600 00000100:00100000:0.0:1788837362.536197:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788837362.536203:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708697600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837362.536424:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708697344 00000100:00100000:1.0:1788837362.536429:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708697344 00000100:00100000:1.0:1788837362.536454:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788837362.536460:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708697344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837362.536499:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708697344:12345-0@lo:400:kworker.0 Request processed in 38us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837362.536506:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788837362.536560:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708697344:0@lo:400:kworker.0 00000100:00100000:0.0:1788837362.536687:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708697600:12345-0@lo:400:kworker.0 Request processed in 482us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837362.536693:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788837362.536759:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708697600:0@lo:400:kworker.0 00000100:00080000:2.0:1788837362.536840:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837362.536845:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788837363.429661:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837364.455688:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837364.582615:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837364.582637:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708697984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837364.582719:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837364.586406:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708697984 00000100:00100000:0.0:1788837364.586422:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708697984 00000100:00100000:0.0:1788837364.586559:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788837364.586572:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708697984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837364.586610:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837364.586691:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708697984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (3972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837364.586698:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788837364.586748:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708697984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837364.586851:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837365.480723:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788837365.606052:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788837366.502441:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837367.525515:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837367.606214:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837367.606256:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837367.606337:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688742144 00000100:00100000:1.0:1788837367.606347:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688742144 00000100:00100000:1.0:1788837367.606398:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 275 00000100:00100000:1.0:1788837367.606408:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2360:x1875731688742144:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837367.606481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2360:x1875731688742144:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 69us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837367.606490:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 275 00000100:00100000:0.0:1788837367.606577:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688742272 00000100:00100000:0.0:1788837367.606582:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688742272 00000100:00100000:0.0:1788837367.606637:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:0.0:1788837367.606647:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688742272:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837367.606681:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688742272:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837367.606688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00080000:1.0:1788837367.606745:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837367.621004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837367.621331:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688742400 00000100:00100000:0.0:1788837367.621341:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688742400 00000100:00100000:0.0:1788837367.621413:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00080000:1.0:1788837367.621419:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837367.622294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837367.622496:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2357:x1875731688742400:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:0.0:1788837367.622528:0:8306:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30554d 00000100:00080000:0.0:1788837367.622537:0:8306:0:(import.c:65:import_set_state_nolock()) ffff9acb6a77d800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788837367.622571:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688742528 00000100:00100000:1.0:1788837367.622577:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688742528 00000001:00000004:0.0:1788837367.622588:0:8306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788837367.622629:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00100000:1.0:1788837367.622640:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2360:x1875731688742528:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837367.622716:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2360:x1875731688742528:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 77us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837367.622724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00080000:1.0:1788837367.622747:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837367.622888:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+2:2357:x1875731688742400:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 1464us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837367.622910:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00010000:00010000:2.0:1788837367.623338:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837367.653712:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708698112:0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.653780:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837367.653840:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708698624:0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.653868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837367.653893:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788837367.653898:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708698240:0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.653919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837367.653937:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708698752:0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.653958:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837367.653991:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708698112 00000100:00100000:2.0:1788837367.653998:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708698112 00000100:00100000:2.0:1788837367.654038:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788837367.654047:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708698112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.654091:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708698112:12345-0@lo:400:kworker.0 Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837367.654110:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788837367.654143:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708698752 00000100:00100000:2.0:1788837367.654147:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708698752 00000100:00100000:2.0:1788837367.654179:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837367.654193:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708698752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.654225:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708698752:12345-0@lo:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837367.654231:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837367.654253:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708698496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837367.654276:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708698624 00000100:00100000:1.0:1788837367.654290:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708698624 00000100:00100000:2.0:1788837367.654335:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837367.654341:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708698240 00000100:00100000:1.0:1788837367.654346:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708698240 00000100:00100000:2.0:1788837367.654360:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837367.654369:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708698368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837367.654371:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788837367.654384:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708698624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.654401:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788837367.654427:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837367.654432:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788837367.654455:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7f551500 x1875731708698752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837367.654468:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708698752:0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.654476:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708698112:0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.654496:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708698368 00000100:00100000:2.0:1788837367.654499:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708698368 00000100:00100000:2.0:1788837367.654521:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788837367.654527:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708698240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837367.654737:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837367.654752:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708698880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837367.654887:0:7291:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788837367.654896:0:7291:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788837367.654948:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708698496 00000100:00100000:0.0:1788837367.654952:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708698496 00000100:00100000:0.0:1788837367.654979:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837367.654986:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708698496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.656328:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708698240:12345-0@lo:400:kworker.0 Request processed in 1796us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837367.656353:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788837367.656381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788837367.656391:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708698368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.656430:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708698368:12345-0@lo:400:kworker.0 Request processed in 42us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837367.656436:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1788837367.656456:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837367.656460:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837367.656489:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708698240:0@lo:400:kworker.0 00000100:00100000:3.0:1788837367.657361:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837367.657409:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708698368:0@lo:400:kworker.0 00000100:00100000:2.0:1788837367.658292:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708698880 00000100:00100000:2.0:1788837367.658319:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708698880 00000100:00100000:2.0:1788837367.658368:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837367.658377:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708698880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837367.658412:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837367.658463:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708698880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837367.658471:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788837367.658609:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb7f550000 x1875731708698880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837367.658626:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708698880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837367.664383:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708698624:0@lo:400:kworker.0 00000100:00100000:0.0:1788837367.668881:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708698496:12345-0@lo:400:kworker.0 Request processed in 13885us (14536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837367.668894:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788837367.672481:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708698496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837367.672497:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708698624:12345-0@lo:400:kworker.0 Request processed in 18111us (18623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837367.672528:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000001:00100000:0.0:1788837368.230439:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:0.0:1788837368.230450:0:6723:0:(genops.c:885:class_export_put()) final put ffff9acb45de5000/4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:1.0:1788837368.230524:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb45de5000/4c93969d-0d98-4501-b440-fa8ca1cd6478 for lustre-OST0000 00000020:00000080:1.0:1788837368.230572:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb6a77d800 for lustre-OST0000 00010000:00010000:0.0:1788837368.549477:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837369.573437:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837369.701612:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708699008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837369.701686:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837369.701882:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708699008 00000100:00100000:0.0:1788837369.701890:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708699008 00000100:00100000:0.0:1788837369.701965:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837369.701975:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708699008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837369.702005:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837369.702049:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708699008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837369.702057:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788837369.702113:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837369.702150:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708699008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837370.597606:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837371.621467:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837372.645533:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837372.727926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837372.727970:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837372.728069:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837372.728147:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688742784 00000100:00100000:2.0:1788837372.728156:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688742784 00000100:00100000:2.0:1788837372.728224:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688742912 00000100:00100000:2.0:1788837372.728228:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688742912 00000100:00100000:2.0:1788837372.728265:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:2.0:1788837372.728275:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2358:x1875731688742784:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837372.728384:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2358:x1875731688742784:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 110us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837372.728392:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:2.0:1788837372.728408:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:2.0:1788837372.728415:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688742912:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837372.728442:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688742912:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837372.728448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00080000:1.0:1788837372.728677:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837372.730292:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688742656 00000100:00100000:0.0:1788837372.730316:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688742656 00000100:00100000:0.0:1788837372.730362:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 277 00000100:00100000:0.0:1788837372.730371:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688742656:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837372.730451:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688742656:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 80us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837372.730459:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 277 00000100:00100000:2.0:1788837372.773854:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708699264:0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.773927:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837372.773946:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708699136:0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.773980:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708699776:0@lo:400:kworker.0 00000100:00100000:0.0:1788837372.773996:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837372.774012:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837372.774031:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708699648:0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.774056:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708699392:0@lo:400:kworker.0 00000100:00100000:0.0:1788837372.774064:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837372.774094:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837372.774117:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837372.774124:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708699520:0@lo:400:kworker.0 00000100:00100000:0.0:1788837372.774132:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708699264 00000100:00100000:0.0:1788837372.774140:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708699264 00000100:00100000:2.0:1788837372.774146:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837372.774192:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708699648 00000100:00100000:0.0:1788837372.774196:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708699648 00000100:00100000:0.0:1788837372.774221:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708699392 00000100:00100000:0.0:1788837372.774224:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708699392 00000100:00100000:0.0:1788837372.774239:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788837372.774259:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708699264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837372.774338:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708699264:12345-0@lo:400:kworker.0 Request processed in 79us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837372.774345:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788837372.774363:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788837372.774370:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708699648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837372.774403:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708699648:12345-0@lo:400:kworker.0 Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837372.774409:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788837372.774422:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788837372.774430:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708699392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.774451:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708699136 00000100:00100000:2.0:1788837372.774457:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708699136 00000100:00100000:0.0:1788837372.774484:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708699392:12345-0@lo:400:kworker.0 Request processed in 55us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837372.774492:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788837372.774493:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788837372.774504:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708699136:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788837372.774523:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837372.774542:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708699136:12345-0@lo:400:kworker.0 Request processed in 41us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837372.774549:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788837372.774558:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708699392:0@lo:400:kworker.0 00000100:00100000:0.0:1788837372.774590:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708699136:0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.774593:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708699776 00000100:00100000:2.0:1788837372.774599:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708699776 00000100:00100000:0.0:1788837372.774603:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708699648:0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.774628:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708699520 00000100:00100000:2.0:1788837372.774631:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708699520 00000100:00100000:2.0:1788837372.774650:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788837372.774656:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708699776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.774756:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708699776:12345-0@lo:400:kworker.0 Request processed in 100us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837372.774762:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788837372.774775:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788837372.774781:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708699520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.774811:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708699520:12345-0@lo:400:kworker.0 Request processed in 30us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837372.774880:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788837372.774910:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837372.774913:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837372.774927:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708699520:0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.774948:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708699264:0@lo:400:kworker.0 00010000:00080000:2.0:1788837372.774961:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb48b76a00 x1875731708699776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837372.774971:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708699776:0@lo:400:kworker.0 00000100:00100000:2.0:1788837372.776039:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837372.776057:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708699904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837372.776109:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837372.776238:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708699904 00000100:00100000:1.0:1788837372.776253:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708699904 00000100:00100000:1.0:1788837372.776290:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788837372.776298:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708699904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837372.776346:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837372.776382:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708699904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837372.776389:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788837372.776469:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb75948700 x1875731708699904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837372.776486:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708699904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788837373.672257:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837374.695109:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837374.823554:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708700032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837374.823625:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837374.823694:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708700032 00000100:00100000:1.0:1788837374.823701:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708700032 00000100:00100000:1.0:1788837374.823752:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788837374.823761:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708700032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837374.823795:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837374.823839:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708700032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837374.823846:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788837374.823865:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837374.823909:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708700032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788837375.720438:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837375.846000:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788837376.462674:0:11852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:16:15 (1788837375) 00010000:00010000:0.0:1788837376.742764:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837377.765869:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837377.847990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837377.848040:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837377.848136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688743168 00000100:00100000:0.0:1788837377.848146:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688743168 00000100:00100000:0.0:1788837377.848230:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:0.0:1788837377.848242:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688743168:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837377.848355:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688743168:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 116us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837377.848362:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00080000:1.0:1788837377.848751:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837377.848806:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688743040 00000100:00100000:2.0:1788837377.848811:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688743040 00000100:00100000:2.0:1788837377.848850:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 279 00000100:00100000:2.0:1788837377.848857:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688743040:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837377.848972:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688743040:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 115us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837377.848979:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 279 00000100:00100000:3.0:1788837377.850630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837377.850815:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688743296 00000100:00100000:0.0:1788837377.850823:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688743296 00000100:00100000:0.0:1788837377.850899:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:0.0:1788837377.850910:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688743296:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837377.850984:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688743296:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 64us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837377.850992:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00080000:2.0:1788837377.851105:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837377.893667:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837377.893688:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708700160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837377.893750:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837377.894069:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708700288:0@lo:400:kworker.0 00000100:00100000:3.0:1788837377.894103:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837377.894141:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708700800:0@lo:400:kworker.0 00000100:00100000:3.0:1788837377.894167:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837377.894184:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837377.894190:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708700672:0@lo:400:kworker.0 00000100:00100000:3.0:1788837377.894223:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837377.894389:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708700800 00000100:00100000:2.0:1788837377.894396:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708700800 00000100:00100000:2.0:1788837377.894458:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788837377.894467:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708700800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837377.894514:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708700800:12345-0@lo:400:kworker.0 Request processed in 48us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837377.894521:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1788837377.894588:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837377.894630:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708700800:0@lo:400:kworker.0 00000100:00100000:1.0:1788837377.894696:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708700160 00000100:00100000:1.0:1788837377.894702:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708700160 00000100:00100000:1.0:1788837377.894749:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837377.894756:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708700160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837377.894783:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837377.894822:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708700160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837377.894829:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837377.894847:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708700416:0@lo:400:kworker.0 00000100:00100000:1.0:1788837377.894872:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837377.894890:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837377.894896:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708700544:0@lo:400:kworker.0 00000100:00100000:1.0:1788837377.894915:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837377.894948:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708700416 00000100:00100000:1.0:1788837377.894952:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708700416 00000100:00100000:1.0:1788837377.894983:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708700544 00000100:00100000:1.0:1788837377.894986:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708700544 00000100:00100000:1.0:1788837377.895008:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788837377.895014:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708700416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837377.895048:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708700416:12345-0@lo:400:kworker.0 Request processed in 34us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837377.895065:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788837377.895078:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788837377.895084:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708700544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837377.895112:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708700544:12345-0@lo:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00010000:00080000:2.0:1788837377.895413:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb75948380 x1875731708700160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837377.895430:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708700160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837377.895469:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708700544:0@lo:400:kworker.0 00000100:00100000:2.0:1788837377.895478:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708700416:0@lo:400:kworker.0 00000100:00100000:1.0:1788837377.895592:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1788837377.895650:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837377.895655:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837377.895707:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708700288 00000100:00100000:0.0:1788837377.895711:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708700288 00000100:00100000:0.0:1788837377.895748:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788837377.895755:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708700288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837377.895809:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708700288:12345-0@lo:400:kworker.0 Request processed in 54us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837377.895816:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788837377.895843:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708700672 00000100:00100000:0.0:1788837377.895846:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708700672 00000100:00100000:0.0:1788837377.895884:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837377.895891:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708700672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837377.895918:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708700672:12345-0@lo:400:kworker.0 Request processed in 28us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837377.895925:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788837377.896006:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708700672:0@lo:400:kworker.0 00000100:00100000:3.0:1788837377.896016:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708700288:0@lo:400:kworker.0 00000100:00080000:1.0:1788837377.896436:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837378.454518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837378.454966:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688743424 00000100:00100000:2.0:1788837378.454977:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688743424 00000100:00100000:2.0:1788837378.455054:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:2.0:1788837378.455065:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:10248:x1875731688743424:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837378.455085:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837378.455108:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba70 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.455187:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be30561f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.455202:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be30561f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.455225:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be30561f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837378.455259:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837378.455262:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837378.455530:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be30561f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.455556:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba70 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.455573:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be30561f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba70 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.455581:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:2.0:1788837378.455583:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837378.455586:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5c00, rc 0) 00000100:00100000:2.0:1788837378.455634:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:10248:x1875731688743424:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 572us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837378.455647:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:1.0:1788837378.462405:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837378.462547:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688743552 00000100:00100000:2.0:1788837378.462557:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688743552 00000100:00100000:2.0:1788837378.462618:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1788837378.462629:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:10249:x1875731688743552:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837378.462647:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837378.462675:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba77 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.462743:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.462756:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.462942:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.462960:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.462968:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.462973:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463179:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4e00/0x843cbef8be30563b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463199:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4e00/0x843cbef8be30563b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463216:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4e00/0x843cbef8be30563b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837378.463246:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837378.463251:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837378.463267:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4e00/0x843cbef8be30563b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463278:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463285:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463292:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463297:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837378.463301:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463432:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463444:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:2.0:1788837378.463447:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837378.463452:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463468:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30562d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463481:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463487:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463493:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463498:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837378.463501:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463506:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463514:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9acb454ce800) 00010000:00010000:2.0:1788837378.463516:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837378.463519:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463524:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305634 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463554:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba77 expref: 8 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463580:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4e00/0x843cbef8be30563b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba77 expref: 7 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837378.463587:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9acb454cea00) 00010000:00010000:2.0:1788837378.463589:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837378.463591:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4e00, rc 0) 00000100:00100000:3.0:1788837378.463826:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:10249:x1875731688743552:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1196us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837378.463835:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1788837378.467816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837378.470849:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688743808 00000100:00100000:1.0:1788837378.470864:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688743808 00000100:00100000:1.0:1788837378.470933:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:1.0:1788837378.470945:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:10249:x1875731688743808:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837378.470966:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837378.470986:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305642 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba7e expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471058:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471072:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471083:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471163:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471171:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471191:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471581:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be305657 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471591:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be305657 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471598:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be305657 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837378.471607:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788837378.471860:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471868:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471874:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471880:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837378.471884:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471891:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471903:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9acb454cea00) 00010000:00010000:1.0:1788837378.471906:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837378.471917:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471923:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305649 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471936:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471941:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471947:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471952:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837378.471955:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471960:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471967:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9acb45631c00) 00010000:00010000:1.0:1788837378.471969:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837378.471971:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.471976:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305650 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.475419:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305642 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba7e expref: 10 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.475460:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be305657 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba7e expref: 9 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837378.475470:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:1.0:1788837378.475473:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837378.475476:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577400, rc 0) 00000100:00100000:1.0:1788837378.475601:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:10249:x1875731688743808:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 4657us (7792us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788837378.475611:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:0.0:1788837378.483714:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837378.483858:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688743936 00000100:00100000:2.0:1788837378.483868:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688743936 00000100:00100000:2.0:1788837378.483924:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1788837378.483934:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:10249:x1875731688743936:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788837378.484043:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:10249:x1875731688743936:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 110us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837378.484050:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00010000:00010000:2.0:1788837378.790412:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788837378.919882:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788837379.817615:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837379.942458:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708700928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837379.942533:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837379.942603:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708700928 00000100:00100000:1.0:1788837379.942610:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708700928 00000100:00100000:1.0:1788837379.942663:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837379.942671:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708700928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837379.942702:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837379.942746:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708700928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837379.942752:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788837379.942771:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837379.942806:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708700928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837380.434987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837380.435052:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688744064 00000100:00100000:2.0:1788837380.435062:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688744064 00000100:00100000:2.0:1788837380.435131:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:2.0:1788837380.435143:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:10291:x1875731688744064:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837380.435162:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837380.435181:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba85 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.435253:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.435276:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.435289:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.435320:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.435327:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.435335:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435559:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435569:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435575:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435581:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837380.435585:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435591:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435603:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:3.0:1788837380.435605:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837380.435615:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435622:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be30566c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435633:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435638:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435643:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435647:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837380.435650:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435655:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435663:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9acb454ce800) 00010000:00010000:3.0:1788837380.435665:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837380.435668:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435674:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305673 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435705:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305665 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba85 expref: 10 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435726:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:3.0:1788837380.435728:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837380.435732:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba85 expref: 10 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.435753:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5200, rc 0) 00000100:00100000:3.0:1788837380.435816:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:10291:x1875731688744064:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 676us (839us total) trans 0 rc 301/301 00000100:00100000:3.0:1788837380.435824:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00080000:1.0:1788837380.438788:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837380.452927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837380.453030:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688744320 00000100:00100000:2.0:1788837380.453040:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688744320 00000100:00100000:2.0:1788837380.453133:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1788837380.453143:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:10291:x1875731688744320:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:2.0:1788837380.453218:0:7291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837380.453244:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be30561f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba70 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.453262:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:2.0:1788837380.453271:0:7291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837380.453500:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.453513:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.453531:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.453543:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.453550:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.453555:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837380.454393:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788837380.454406:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.454414:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.454421:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.454427:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837380.454436:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.454444:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.454456:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454ce200) 00010000:00010000:2.0:1788837380.454459:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837380.454470:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.454476:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30567a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837380.454491:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6ab712d reply state 00000000dee6cebd transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837380.454499:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837380.454607:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:10291:x1875731688744320:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 1464us (1686us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788837380.454616:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00010000:00010000:1.0:1788837380.463566:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.463601:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.463609:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.463615:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837380.463620:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.463628:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.463644:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9acb454cec00) 00010000:00010000:1.0:1788837380.463647:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837380.463650:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.463657:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305681 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837380.573932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837380.574018:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688744448 00000100:00100000:1.0:1788837380.574028:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688744448 00000100:00100000:1.0:1788837380.574081:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:1.0:1788837380.574091:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:10299:x1875731688744448:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:1.0:1788837380.574125:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837380.574148:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be305688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba8c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.574237:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30568f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.574250:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30568f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.574261:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30568f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837380.574295:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788837380.574299:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837380.574369:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30568f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.574393:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be305688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba8c expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.574408:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30568f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba8c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.574417:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:1.0:1788837380.574420:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837380.574424:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576600, rc 0) 00000100:00100000:1.0:1788837380.574486:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:10299:x1875731688744448:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 397us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837380.574493:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1788837380.647249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837380.647337:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688744576 00000100:00100000:3.0:1788837380.647347:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688744576 00000100:00100000:3.0:1788837380.647400:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1788837380.647411:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:10305:x1875731688744576:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1788837380.647431:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837380.647451:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be305696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba93 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647516:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647530:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647541:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647572:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647579:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647584:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647664:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be3056ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647671:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be3056ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647678:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be3056ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837380.647700:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788837380.647703:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837380.647736:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be3056ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647747:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647753:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647760:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647775:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837380.647780:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647788:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647800:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:3.0:1788837380.647803:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837380.647807:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647812:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be30569d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647825:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647831:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647836:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647840:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ae00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837380.647843:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647848:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647864:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9acb4556db00) 00010000:00010000:3.0:1788837380.647866:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837380.647869:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647875:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3056a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647902:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be305696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba93 expref: 12 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647914:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be3056ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba93 expref: 11 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.647920:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837380.647922:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788837380.647924:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167b400, rc 0) 00000100:00100000:3.0:1788837380.648058:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:10305:x1875731688744576:12345-192.168.203.43@tcp:101:bash.0 Request processed in 648us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837380.648066:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:2.0:1788837380.658968:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837380.662469:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688744832 00000100:00100000:1.0:1788837380.662486:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688744832 00000100:00100000:1.0:1788837380.662605:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:1.0:1788837380.662617:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:10305:x1875731688744832:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1788837380.662638:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837380.662660:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be3056b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbba9a expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.662797:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.662813:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.662826:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.662876:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.662884:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.662892:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837380.663484:0:7291:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788837380.663656:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663668:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663677:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663719:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663726:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663732:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663738:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837380.663742:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663749:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663766:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:1.0:1788837380.663769:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837380.663774:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663780:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3056b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837380.663793:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008901a89e reply state 0000000042902e64 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837380.663802:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788837380.663827:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be3056b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba9a expref: 14 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663853:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba9a expref: 13 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.663860:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631700) 00010000:00010000:1.0:1788837380.663863:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837380.663865:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577600, rc 0) 00000100:00100000:1.0:1788837380.663940:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:10305:x1875731688744832:12345-192.168.203.43@tcp:101:bash.0 Request processed in 1325us (4980us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788837380.663948:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00010000:00010000:3.0:1788837380.669395:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.669412:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.669420:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.669445:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837380.669450:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.669458:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.669475:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb45631200) 00010000:00010000:3.0:1788837380.669478:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837380.669482:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837380.669488:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3056c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837380.672866:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837380.672967:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688744960 00000100:00100000:0.0:1788837380.672977:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688744960 00000100:00100000:0.0:1788837380.673023:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:0.0:1788837380.673032:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875731688744960:12345-192.168.203.43@tcp:8:bash.0 00010000:00080000:0.0:1788837380.673061:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:0.0:1788837380.673088:0:6700:0:(genops.c:1385:class_connect()) connect: client 4c93969d-0d98-4501-b440-fa8ca1cd6478, cookie 0x843cbef8be3056d5 00002000:00100000:0.0:1788837380.673099:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c93969d-0d98-4501-b440-fa8ca1cd6478/ffff9acb44fca800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788837380.673121:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788837380.673525:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788837380.673555:0:6700:0:(import.c:65:import_set_state_nolock()) ffff9acb44fcc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837380.673659:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2357:x1875731688744960:12345-192.168.203.43@tcp:8:bash.0 Request processed in 627us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837380.673667:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1788837380.681646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837380.681796:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688745088 00000100:00100000:0.0:1788837380.681806:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688745088 00000100:00100000:0.0:1788837380.681877:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1788837380.681887:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:0:x1875731688745088:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837380.681903:0:8306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837380.681923:0:8306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbaa1 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837380.681946:0:8306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837380.681964:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1788837380.681968:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837380.681977:0:8306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa1 expref: 7 pid: 8306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.681996:0:8306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa1 expref: 7 pid: 8306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.682009:0:8306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917a600, rc 0) 00000100:00100000:0.0:1788837380.682076:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:0:x1875731688745088:12345-192.168.203.43@tcp:101:bash.0 Request processed in 191us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837380.682083:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00080000:1.0:1788837380.682684:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837380.685425:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837380.685585:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688745216 00000100:00100000:2.0:1788837380.685594:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688745216 00000100:00100000:2.0:1788837380.685650:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:2.0:1788837380.685659:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:10305:x1875731688745216:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1788837380.685675:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837380.685694:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbaa8 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.685722:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa1 expref: 8 pid: 8306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.685731:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837380.685735:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837380.685752:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.685797:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa1 expref: 8 pid: 8306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.685811:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa1 expref: 8 pid: 8306 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837380.685826:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1875731708701056:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837380.685933:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50f9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788837380.689089:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1875731708701056:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837380.689128:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.689148:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4400, rc 0) 00000100:00100000:2.0:1788837380.689212:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:10305:x1875731688745216:12345-192.168.203.43@tcp:101:bash.0 Request processed in 3554us (3795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837380.689221:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1788837380.692771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837380.693378:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688745344 00000100:00100000:1.0:1788837380.693388:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688745344 00010000:00010000:1.0:1788837380.693427:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa1 expref: 8 pid: 8306 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837380.693474:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:1.0:1788837380.693484:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2361:x1875731688745344:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837380.693500:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837380.693521:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa1 expref: 8 pid: 8306 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.693553:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa1 expref: 8 pid: 8306 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.693578:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ac38582/0x843cbef8be3056dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa1 expref: 8 pid: 8306 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.693609:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837380.693613:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837380.693622:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.693632:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.693669:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837380.693684:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875731708701184:192.168.203.43@tcp:105: 00000100:00100000:1.0:1788837380.693767:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837380.701913:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875731708701184:192.168.203.43@tcp:105: 00010000:00010000:1.0:1788837380.701944:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837380.702010:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688745344:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 8526us (9247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837380.702021:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:3.0:1788837380.705037:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837380.705259:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688745600 00000100:00100000:2.0:1788837380.705269:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688745600 00000100:00100000:2.0:1788837380.705568:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1788837380.705581:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10305:x1875731688745600:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:2.0:1788837380.705942:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:10305:x1875731688745600:12345-192.168.203.43@tcp:35:bash.0 Request processed in 364us (912us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788837380.705958:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1788837380.821742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837380.821845:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688745856 00000100:00100000:2.0:1788837380.821856:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688745856 00000100:00100000:2.0:1788837380.821917:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:2.0:1788837380.821927:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:10315:x1875731688745856:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837380.821952:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837380.821972:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3056ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbaaf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837380.822056:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788837380.822181:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3056ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaaf expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.822206:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:2.0:1788837380.822209:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837380.822214:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3056ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaaf expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.822228:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4c00, rc 0) 00000100:00100000:2.0:1788837380.822349:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:10315:x1875731688745856:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 378us (569us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788837380.822357:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:3.0:1788837380.827932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837380.828023:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688746112 00000100:00100000:0.0:1788837380.828044:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688746112 00000100:00100000:0.0:1788837380.828200:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1788837380.828213:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:10315:x1875731688746112:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1788837380.828497:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:10315:x1875731688746112:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 286us (573us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788837380.830523:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00010000:00010000:2.0:1788837380.837531:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837380.951249:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837380.951504:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688746240 00000100:00100000:2.0:1788837380.951515:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688746240 00000100:00100000:2.0:1788837380.951574:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:2.0:1788837380.951585:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:10322:x1875731688746240:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837380.951621:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837380.951642:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3056f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbab6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.951709:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3056ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.951723:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3056ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.951735:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3056ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837380.951768:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788837380.951771:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837380.951788:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3056ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.951814:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be3056f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbab6 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.951833:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3056ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbab6 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.951842:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:2.0:1788837380.951845:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837380.951849:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5800, rc 0) 00000100:00100000:2.0:1788837380.951953:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:10322:x1875731688746240:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 370us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837380.951960:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:3.0:1788837380.963624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837380.963711:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688746496 00000100:00100000:1.0:1788837380.963721:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688746496 00000100:00100000:1.0:1788837380.963780:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1788837380.963790:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:10322:x1875731688746496:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837380.963812:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837380.963834:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be305706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbabd expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.963943:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be30570d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.963958:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be30570d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.963969:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be30570d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837380.963980:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788837380.964239:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be305706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbabd expref: 20 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.964257:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be30570d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbabd expref: 19 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.964267:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631700) 00010000:00010000:1.0:1788837380.964269:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837380.964273:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577000, rc 0) 00000100:00100000:1.0:1788837380.964413:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:10322:x1875731688746496:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 623us (796us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788837380.964421:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:3.0:1788837380.972293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837380.973277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837380.973383:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688746880 00000100:00100000:0.0:1788837380.973402:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688746880 00000100:00100000:0.0:1788837380.973468:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:0.0:1788837380.973479:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:10322:x1875731688746880:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837380.973504:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837380.973524:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30571b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbac4 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.973616:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305722 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.973631:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.973643:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837380.973655:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788837380.973768:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30571b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbac4 expref: 22 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.973785:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305722 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbac4 expref: 21 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.973804:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631700) 00010000:00010000:0.0:1788837380.973807:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788837380.973811:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917b000, rc 0) 00000100:00100000:0.0:1788837380.973867:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:10322:x1875731688746880:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 390us (592us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788837380.973873:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:2.0:1788837380.974129:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688746624 00000100:00100000:2.0:1788837380.974200:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688746624 00000100:00100000:2.0:1788837380.974250:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1788837380.974260:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:2358:x1875731688746624:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837380.974272:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837380.974289:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be30570d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbabd expref: 21 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837380.974335:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631700) 00010000:00010000:2.0:1788837380.974340:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837380.974364:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:2358:x1875731688746624:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 106us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837380.974371:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:3.0:1788837380.987397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837380.987735:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688747008 00000100:00100000:0.0:1788837380.987745:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688747008 00000100:00100000:0.0:1788837380.987795:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:0.0:1788837380.987805:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688747008:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:0.0:1788837380.987846:0:8306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.987866:0:8306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.987875:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837380.987880:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837380.987885:0:8306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.987919:0:8306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837380.987933:0:8306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 7 pid: 6698 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837380.987959:0:8306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74eff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8306:1875731708701312:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837380.988245:0:8306:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4904f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837380.991893:0:8306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74eff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8306:1875731708701312:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837380.991924:0:8306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837380.999601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837380.999744:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688747136 00000100:00100000:1.0:1788837380.999754:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688747136 00002000:00100000:1.0:1788837380.999799:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9acb74eff800 x1875731688747136/t0(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:36/0 lens 504/0 e 0 to 0 dl 1788837391 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837380.999809:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74eff800 with x1875731688747136 ext(0->12) 00010000:00010000:1.0:1788837380.999831:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 8 pid: 6698 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837380.999847:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 8 pid: 6698 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837380.999855:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9acb74eff800 00000100:00100000:1.0:1788837380.999927:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1788837380.999937:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688747136:12345-192.168.203.43@tcp:4:lfs.0 00000001:00100000:1.0:1788837381.065549:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000100:00100000:3.0:1788837381.068366:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688747136:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 68422us (68765us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788837381.069762:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00002000:00100000:3.0:1788837381.069780:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9acb74eff800 x1875731688747136/t4294967299(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:36/0 lens 504/448 e 0 to 0 dl 1788837391 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837381.069806:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74eff800 with x1875731688747136 ext(0->12) 00010000:00010000:3.0:1788837381.069818:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 9 pid: 6698 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.069835:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 9 pid: 6698 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837381.069844:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9acb74eff800 00000100:00100000:3.0:1788837381.075863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837381.075976:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688747264 00000100:00100000:0.0:1788837381.075986:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688747264 00010000:00010000:0.0:1788837381.076027:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 9 pid: 6698 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837381.076125:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:0.0:1788837381.076137:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688747264:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837381.076152:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788837381.076169:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788837381.076173:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788837381 00002000:00010000:0.0:1788837381.076176:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788837381 00002000:00010000:0.0:1788837381.076178:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788837381 00010000:00010000:0.0:1788837381.076184:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 9 pid: 6698 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.076210:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 9 pid: 6698 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.076264:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be3056e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaa8 expref: 9 pid: 6698 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.076281:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837381.076285:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837381.076290:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.076300:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.076370:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837381.076420:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688747264:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 285us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837381.076429:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00010000:00010000:3.0:1788837381.076490:0:8306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.076499:0:8306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.076524:0:8306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.076533:0:8306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.076540:0:8306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.076547:0:8306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ac00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837381.076559:0:8306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.076567:0:8306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.076580:0:8306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.076588:0:8306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003daafd43/0x843cbef8be305730 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837381.076638:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688747008:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 88834us (89259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837381.076645:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1788837381.088077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837381.088646:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688747520 00000100:00100000:0.0:1788837381.088657:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688747520 00000100:00100000:0.0:1788837381.088727:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1788837381.088737:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:10322:x1875731688747520:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:0.0:1788837381.088798:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305722 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbac4 expref: 20 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837381.089074:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788837381.089128:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788837381.090029:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788837381.090098:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.090120:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba9a expref: 24 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.090129:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.090163:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba9a expref: 24 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.090178:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba9a expref: 24 pid: 7291 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837381.090201:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875731708701440:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837381.090593:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837381.101241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.101400:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688747648 00000100:00100000:1.0:1788837381.101409:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688747648 00010000:00010000:1.0:1788837381.101454:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba9a expref: 25 pid: 7291 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837381.101490:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:1.0:1788837381.101501:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+25:2361:x1875731688747648:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837381.101516:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837381.101523:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba9a expref: 25 pid: 7291 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.101536:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba9a expref: 25 pid: 7291 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.101557:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631700) 00010000:00010000:1.0:1788837381.101563:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.101584:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.101592:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.101609:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837381.101664:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+25:2361:x1875731688747648:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 165us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837381.101680:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00010000:00010000:2.0:1788837381.101886:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3056c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba9a expref: 24 pid: 7291 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837381.101902:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875731708701440:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837381.101922:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.101931:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.101937:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837381.102050:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788837381.102645:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788837381.102841:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708701568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837381.102948:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837381.103056:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7ae326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837381.103121:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708701568 00000100:00100000:2.0:1788837381.103127:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708701568 00000100:00100000:2.0:1788837381.103179:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837381.103200:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875731708701568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788837381.103275:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875731708701568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837381.103283:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788837381.103562:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837381.103628:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708701568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788837381.104421:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788837381.104488:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708701696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837381.104607:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837381.104633:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837381.105466:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708701696 00000100:00100000:2.0:1788837381.105473:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708701696 00000100:00100000:2.0:1788837381.105512:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837381.105520:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875731708701696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788837381.105816:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1875731708701696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 293us (1205us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788837381.105823:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837381.105989:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708701696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788837381.106050:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788837381.106101:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.106111:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.106119:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.106125:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917be00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837381.106130:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.106136:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.106151:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631700) 00010000:00010000:3.0:1788837381.106155:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788837381.106159:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.106166:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305737 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837381.106550:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788837381.107000:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788837381.107010:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334957705440ns, next at 335957703748ns, rc = 0 00000001:00080000:3.0:1788837381.107016:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788837381.107055:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631700) 00010000:00010000:3.0:1788837381.107057:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788837381.107063:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305722 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbac4 expref: 28 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837381.107178:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:10322:x1875731688747520:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 18442us (19108us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788837381.108267:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000020:00080000:3.0:1788837381.108275:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788837381.111021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.111293:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688747776 00000100:00100000:1.0:1788837381.111420:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688747776 00000100:00100000:1.0:1788837381.111504:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:1.0:1788837381.111514:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:10322:x1875731688747776:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837381.111537:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837381.111559:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be30573e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbacb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.111615:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be30573e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbacb expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.111628:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be30573e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbacb expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.111652:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:1.0:1788837381.111655:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837381.111727:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576e00, rc 0) 00000100:00100000:1.0:1788837381.111815:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:10322:x1875731688747776:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 302us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837381.111822:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:2.0:1788837381.114646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.114809:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688748032 00000100:00100000:1.0:1788837381.114818:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688748032 00000100:00100000:1.0:1788837381.114875:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1788837381.114886:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:10322:x1875731688748032:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837381.115345:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:10322:x1875731688748032:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 459us (706us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788837381.115353:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:3.0:1788837381.217977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.218482:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688748288 00000100:00100000:1.0:1788837381.218492:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688748288 00000100:00100000:1.0:1788837381.218597:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:1.0:1788837381.218608:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:10332:x1875731688748288:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837381.218633:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837381.218653:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305745 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbad2 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837381.218737:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788837381.218856:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305745 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad2 expref: 31 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.218870:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:1.0:1788837381.218873:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837381.218878:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305745 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad2 expref: 31 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.218922:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576a00, rc 0) 00000100:00100000:1.0:1788837381.218987:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+30:10332:x1875731688748288:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 381us (1022us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788837381.218994:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:1.0:1788837381.222173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837381.222650:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688748416 00000100:00100000:2.0:1788837381.222660:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688748416 00000100:00100000:2.0:1788837381.222717:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:2.0:1788837381.222730:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+30:10332:x1875731688748416:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:2.0:1788837381.222807:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.222825:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.222838:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.222854:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.222875:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.222883:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.222992:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223001:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223009:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837381.223045:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223055:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223059:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223063:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223067:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837381.223070:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223074:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223088:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:2.0:1788837381.223090:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837381.223094:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223098:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223108:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223111:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223114:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223117:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837381.223119:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223122:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223126:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb454ce200) 00010000:00010000:2.0:1788837381.223127:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837381.223128:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223131:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30575a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223147:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223150:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223154:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223156:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837381.223158:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223161:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223165:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:2.0:1788837381.223166:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837381.223168:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.223171:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305761 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837381.223259:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+30:10332:x1875731688748416:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 532us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837381.223266:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:2.0:1788837381.226508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837381.226763:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688748672 00000100:00100000:3.0:1788837381.226848:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688748672 00000100:00100000:3.0:1788837381.226965:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1788837381.226977:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+30:10332:x1875731688748672:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1788837381.227285:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:10332:x1875731688748672:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 310us (1015us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788837381.227293:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1788837381.269396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.269703:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688748928 00000100:00100000:1.0:1788837381.269712:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688748928 00000100:00100000:1.0:1788837381.269770:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1788837381.269780:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:10335:x1875731688748928:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837381.269801:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837381.269821:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305768 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbad9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.269892:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270011:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270025:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270041:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270049:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270074:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270183:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270201:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270209:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837381.270219:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788837381.270725:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270735:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270743:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270750:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837381.270754:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270762:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270774:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:1.0:1788837381.270777:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837381.270790:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270796:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30576f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270810:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270815:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270821:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270826:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837381.270840:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270846:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270854:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb45631100) 00010000:00010000:1.0:1788837381.270856:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837381.270859:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270864:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305776 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270916:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305768 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad9 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270944:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad9 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.270951:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:1.0:1788837381.270953:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837381.270955:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576c00, rc 0) 00000100:00100000:1.0:1788837381.271027:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+33:10335:x1875731688748928:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1248us (1640us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788837381.271036:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1788837381.282367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837381.282485:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688749056 00000100:00100000:2.0:1788837381.282495:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688749056 00000100:00100000:2.0:1788837381.282621:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:2.0:1788837381.282633:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+33:10335:x1875731688749056:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1788837381.282701:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.282719:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.282730:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.282754:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.282761:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.282768:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.282774:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837381.282778:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.282785:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.282797:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:2.0:1788837381.282800:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837381.282804:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.282821:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30578b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837381.282902:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+33:10335:x1875731688749056:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 271us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837381.282909:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:2.0:1788837381.292593:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.292685:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688749312 00000100:00100000:1.0:1788837381.292696:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688749312 00000100:00100000:1.0:1788837381.292752:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1788837381.292762:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+33:10335:x1875731688749312:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837381.293006:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:10335:x1875731688749312:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 245us (420us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788837381.293013:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1788837381.628347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837381.628438:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688749568 00000100:00100000:2.0:1788837381.628447:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688749568 00000100:00100000:2.0:1788837381.628500:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:2.0:1788837381.628509:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:10366:x1875731688749568:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:2.0:1788837381.628530:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837381.628560:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbae0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.628654:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.628669:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.628681:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837381.628691:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788837381.628830:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae0 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.628848:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae0 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.628868:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:2.0:1788837381.628871:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837381.628875:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5200, rc 0) 00000100:00100000:2.0:1788837381.628936:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:10366:x1875731688749568:12345-192.168.203.43@tcp:101:cat.0 Request processed in 428us (632us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788837381.628943:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:0.0:1788837381.633570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837381.633617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.633736:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688749696 00000100:00100000:1.0:1788837381.633746:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688749696 00000100:00100000:1.0:1788837381.633812:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:1.0:1788837381.633821:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:2361:x1875731688749696:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837381.633837:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837381.633863:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae0 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.633905:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:1.0:1788837381.633911:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837381.633971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:2361:x1875731688749696:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 151us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837381.633978:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1788837381.634239:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688749952 00000100:00100000:2.0:1788837381.634244:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688749952 00000100:00100000:2.0:1788837381.634282:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1788837381.634289:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:10366:x1875731688749952:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:2.0:1788837381.634565:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:10366:x1875731688749952:12345-192.168.203.43@tcp:35:cat.0 Request processed in 276us (947us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788837381.634573:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1788837381.691138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.691249:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688750208 00000100:00100000:1.0:1788837381.691259:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688750208 00000100:00100000:1.0:1788837381.691345:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1788837381.691357:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:10372:x1875731688750208:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:1.0:1788837381.691393:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837381.691396:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788837381.691422:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3056ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbab6 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.691443:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:1.0:1788837381.691448:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837381.691461:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3057a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbae7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.691562:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.691575:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad9 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.691583:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.691628:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad9 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.691641:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad9 expref: 36 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837381.691653:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7594b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708701824:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837381.691754:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7518c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837381.700366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.700879:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7594b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708701824:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837381.700922:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837381.702368:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688750336 00000100:00100000:2.0:1788837381.702479:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688750336 00010000:00010000:2.0:1788837381.702526:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad9 expref: 37 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837381.702700:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:2.0:1788837381.702711:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:2361:x1875731688750336:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837381.702726:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837381.702733:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad9 expref: 37 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.702746:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad9 expref: 37 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.702785:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30577d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbad9 expref: 37 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.702801:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:2.0:1788837381.702805:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.702814:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.702822:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837381.702856:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837381.702929:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:2361:x1875731688750336:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 219us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837381.702936:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00010000:00010000:0.0:1788837381.703003:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.703011:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837381.703027:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788837381.703213:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3057a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae7 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.703234:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae7 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837381.703242:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:0.0:1788837381.703245:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837381.703248:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577000, rc 0) 00000100:00100000:0.0:1788837381.703271:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:10372:x1875731688750208:12345-192.168.203.43@tcp:101:dd.0 Request processed in 11918us (12145us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788837381.703279:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:0.0:1788837381.711791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837381.711884:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688750592 00000100:00100000:1.0:1788837381.711893:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688750592 00000100:00100000:1.0:1788837381.711962:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:1.0:1788837381.711973:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:10372:x1875731688750592:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:1.0:1788837381.712248:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.712264:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.712276:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837381.712346:0:7291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788837381.712372:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7562c05 reply state 000000000b9f3d3e transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837381.712405:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788837381.712503:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+39:10372:x1875731688750592:12345-192.168.203.43@tcp:36:dd.0 Request processed in 532us (720us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788837381.712509:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000020:00080000:1.0:1788837381.712514:0:7291:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837381.718236:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.718256:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.718265:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.718282:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837381.718288:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.718296:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.718341:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:1.0:1788837381.718344:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837381.718350:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837381.718358:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3057bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837381.862284:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837382.099498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837382.100897:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688750720 00000100:00100000:3.0:1788837382.100909:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688750720 00000100:00100000:3.0:1788837382.101008:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:3.0:1788837382.101019:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:10386:x1875731688750720:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:3.0:1788837382.101051:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837382.101071:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3057c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbaee expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101143:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101175:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101197:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101213:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101221:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101227:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101340:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101352:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae7 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101360:0:11703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101393:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae7 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.101407:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae7 expref: 39 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837382.101432:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875731708701952:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837382.101570:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d76c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788837382.101635:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837382.110657:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875731708701952:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837382.110688:0:11703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837382.111370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837382.113707:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688750976 00000100:00100000:2.0:1788837382.113720:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688750976 00000100:00100000:2.0:1788837382.113784:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1788837382.113795:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:5595:x1875731688750976:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788837382.114201:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:5595:x1875731688750976:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 406us (2833us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788837382.114209:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1788837382.118051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.118254:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688751104 00000100:00100000:1.0:1788837382.118263:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688751104 00010000:00010000:1.0:1788837382.118300:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae7 expref: 41 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837382.118381:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1788837382.118392:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:2361:x1875731688751104:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837382.118407:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837382.118413:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae7 expref: 41 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.118428:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae7 expref: 41 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.118449:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbae7 expref: 41 pid: 5844 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.118464:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:1.0:1788837382.118469:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.118478:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.118486:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.118510:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837382.118560:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:2361:x1875731688751104:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 170us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837382.118582:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00010000:00010000:3.0:1788837382.118754:0:11703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118762:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837382.118801:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788837382.118805:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837382.118845:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118857:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118867:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118873:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118879:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118885:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ac00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837382.118895:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118903:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118912:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837382.118915:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837382.118919:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118925:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118936:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118942:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118948:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118953:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837382.118956:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118962:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118969:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb4556d500) 00010000:00010000:3.0:1788837382.118971:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837382.118980:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.118987:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.119023:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3057c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaee expref: 40 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.119036:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaee expref: 39 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.119044:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:3.0:1788837382.119047:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837382.119049:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167b800, rc 0) 00000100:00100000:3.0:1788837382.119081:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+39:10386:x1875731688750720:12345-192.168.203.43@tcp:101:stat.0 Request processed in 18064us (19593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837382.119088:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:0.0:1788837382.179028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.183254:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688751360 00000100:00100000:1.0:1788837382.183271:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688751360 00000100:00100000:1.0:1788837382.183366:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:1.0:1788837382.184178:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+39:10392:x1875731688751360:12345-192.168.203.43@tcp:36:truncate.0 00010000:00010000:1.0:1788837382.184246:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837382.184277:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaee expref: 39 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.184300:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:1.0:1788837382.184360:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837382.184795:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.184810:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.184820:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837382.184868:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788837382.184894:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000813a64bd reply state 00000000d702ff4e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837382.184903:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788837382.185037:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:10392:x1875731688751360:12345-192.168.203.43@tcp:36:truncate.0 Request processed in 871us (6017us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788837382.185045:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000020:00080000:1.0:1788837382.185074:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837382.193938:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.193954:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.193961:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.193967:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837382.193972:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.193994:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.194010:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:3.0:1788837382.194013:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837382.194018:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.194028:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3057df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837382.353126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837382.353390:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688751488 00000100:00100000:3.0:1788837382.353402:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688751488 00000100:00100000:3.0:1788837382.353465:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1788837382.353487:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:10406:x1875731688751488:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:3.0:1788837382.353516:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837382.353538:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3057e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbaf5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353610:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353625:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353637:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353651:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353679:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353687:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353784:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353793:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353799:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837382.353835:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788837382.353840:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837382.353859:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353871:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353880:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353887:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353893:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353910:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837382.353915:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353923:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353936:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837382.353940:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837382.353945:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353951:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be3057ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353965:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353971:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353977:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353982:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ac00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837382.353985:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.353992:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.354014:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb4556d500) 00010000:00010000:3.0:1788837382.354017:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837382.354020:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.354026:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be3057f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.354643:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be3057e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaf5 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.354661:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaf5 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.354669:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:3.0:1788837382.354672:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837382.354675:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167b800, rc 0) 00000100:00100000:3.0:1788837382.354857:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:10406:x1875731688751488:12345-192.168.203.43@tcp:101:stat.0 Request processed in 1382us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837382.354866:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:0.0:1788837382.484077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837382.484191:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688751744 00000100:00100000:3.0:1788837382.484202:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688751744 00000100:00100000:3.0:1788837382.484264:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:3.0:1788837382.484275:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:10416:x1875731688751744:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837382.484294:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837382.484339:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbafc expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837382.484459:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788837382.484570:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305802 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbafc expref: 43 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.484585:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:3.0:1788837382.484589:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837382.484594:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbafc expref: 43 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.484608:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167ae00, rc 0) 00000100:00100000:3.0:1788837382.484667:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+42:10416:x1875731688751744:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 393us (599us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788837382.484675:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:1.0:1788837382.488511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837382.488698:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688752000 00000100:00100000:2.0:1788837382.488708:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688752000 00000100:00100000:2.0:1788837382.488772:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1788837382.488795:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+42:10416:x1875731688752000:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1788837382.489259:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+43:10416:x1875731688752000:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 465us (986us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788837382.489267:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1788837382.611588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.612144:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688752256 00000100:00100000:1.0:1788837382.612155:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688752256 00000100:00100000:1.0:1788837382.612227:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1788837382.612238:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+43:10423:x1875731688752256:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1788837382.612261:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837382.612282:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305810 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb03 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.612694:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.612714:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaf5 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.612723:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.612755:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaf5 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.612769:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaf5 expref: 44 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837382.612783:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75948380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708702080:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837382.612881:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837382.622680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.622810:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75948380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708702080:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837382.622829:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688752384 00000100:00100000:2.0:1788837382.622838:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688752384 00010000:00010000:1.0:1788837382.622860:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.622894:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaf5 expref: 45 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837382.623059:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:2.0:1788837382.623074:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+45:2361:x1875731688752384:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837382.623090:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837382.623098:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaf5 expref: 45 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.623111:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaf5 expref: 45 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.623133:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be3057fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbaf5 expref: 45 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.623151:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:2.0:1788837382.623156:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.623265:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.623285:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.623556:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837382.623619:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+44:2361:x1875731688752384:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 548us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837382.623627:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00010000:00010000:0.0:1788837382.624681:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.624694:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837382.624714:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788837382.625045:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305810 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb03 expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.625084:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb03 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.625093:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:0.0:1788837382.625096:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837382.625099:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577e00, rc 0) 00000100:00100000:0.0:1788837382.625159:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+44:10423:x1875731688752256:12345-192.168.203.43@tcp:101:bash.0 Request processed in 12922us (13581us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788837382.625679:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:0.0:1788837382.633724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837382.633812:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688752640 00000100:00100000:3.0:1788837382.633821:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688752640 00000100:00100000:3.0:1788837382.633888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:3.0:1788837382.633899:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+44:10423:x1875731688752640:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:3.0:1788837382.634207:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.634226:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.634238:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837382.634291:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788837382.634358:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000332e1d09 reply state 00000000d8e60344 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837382.634367:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837382.634713:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:10423:x1875731688752640:12345-192.168.203.43@tcp:36:bash.0 Request processed in 813us (996us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788837382.634721:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000020:00080000:3.0:1788837382.634725:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837382.636759:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.636777:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.636784:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.636790:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ae00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837382.636795:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.636803:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.636821:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:1.0:1788837382.636824:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837382.636829:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.636835:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be305825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837382.644111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837382.644229:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688752768 00000100:00100000:2.0:1788837382.644239:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688752768 00000100:00100000:2.0:1788837382.644299:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:2.0:1788837382.644366:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+46:10423:x1875731688752768:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1788837382.644402:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837382.644424:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30582c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb0a expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.644547:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.644562:0:7291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb03 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.644570:0:7291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.644603:0:7291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb03 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837382.644617:0:7291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb03 expref: 47 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837382.644646:0:7291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7291:1875731708702208:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837382.644725:0:7291:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50f9c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788837382.648854:0:7291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7291:1875731708702208:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837382.648897:0:7291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837382.651605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.651911:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688752896 00000100:00100000:1.0:1788837382.651932:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688752896 00010000:00010000:1.0:1788837382.652409:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb03 expref: 48 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837382.652457:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1788837382.652467:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+48:2361:x1875731688752896:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837382.652482:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837382.652489:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb03 expref: 48 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.652502:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb03 expref: 48 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.652525:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305817 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb03 expref: 48 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.652542:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:1.0:1788837382.652547:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.652556:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.652565:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.652603:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837382.652654:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:2361:x1875731688752896:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 188us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837382.652672:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00010000:00010000:3.0:1788837382.652829:0:7291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.652838:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837382.652892:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788837382.652897:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837382.652916:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.652955:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30582c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb0a expref: 47 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.652969:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb0a expref: 46 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.652976:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:3.0:1788837382.652978:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837382.652981:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5800, rc 0) 00000100:00100000:3.0:1788837382.653007:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+46:10423:x1875731688752768:12345-192.168.203.43@tcp:101:bash.0 Request processed in 8644us (8907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837382.653014:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:2.0:1788837382.659673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.659909:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688753152 00000100:00100000:1.0:1788837382.659919:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688753152 00000100:00100000:1.0:1788837382.660272:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:1.0:1788837382.660283:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db2e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+46:10423:x1875731688753152:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:1.0:1788837382.660555:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db2e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:10423:x1875731688753152:12345-192.168.203.43@tcp:35:bash.0 Request processed in 273us (889us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788837382.660563:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1788837382.764408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.764753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688753408 00000100:00100000:1.0:1788837382.764763:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688753408 00000100:00100000:1.0:1788837382.764822:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1788837382.764832:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:10433:x1875731688753408:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837382.764879:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837382.764901:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30583a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb11 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837382.765021:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788837382.765376:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30583a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb11 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.765391:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:1.0:1788837382.765394:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837382.765399:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30583a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb11 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837382.765412:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577e00, rc 0) 00000100:00100000:1.0:1788837382.765805:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+48:10433:x1875731688753408:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 973us (1406us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788837382.765813:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:3.0:1788837382.772924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837382.773016:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688753536 00000100:00100000:0.0:1788837382.773033:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688753536 00000100:00100000:0.0:1788837382.773093:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:0.0:1788837382.773103:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+48:10433:x1875731688753536:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1788837382.773190:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773207:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773218:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773234:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773248:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773255:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773382:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773391:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773402:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837382.773453:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773464:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773470:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773476:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773481:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ae00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837382.773485:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773491:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773507:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:0.0:1788837382.773510:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837382.773514:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773521:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305848 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773535:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773541:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773546:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773550:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ba00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837382.773552:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773557:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773562:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb50df5400) 00010000:00010000:0.0:1788837382.773564:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837382.773566:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773571:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be30584f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773591:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773597:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773602:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773606:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837382.773608:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773613:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773618:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:0.0:1788837382.773620:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837382.773622:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.773627:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837382.773696:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+48:10433:x1875731688753536:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 595us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837382.773703:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:2.0:1788837382.778403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.778573:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688753792 00000100:00100000:1.0:1788837382.778584:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688753792 00000100:00100000:1.0:1788837382.778645:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1788837382.778655:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+48:10433:x1875731688753792:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837382.778889:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+49:10433:x1875731688753792:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 234us (495us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788837382.778898:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1788837382.845645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837382.848775:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688754048 00000100:00100000:3.0:1788837382.848790:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688754048 00000100:00100000:3.0:1788837382.848867:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1788837382.848878:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7594b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+49:10436:x1875731688754048:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837382.848904:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837382.848923:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be30585d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb18 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.848996:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849010:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849021:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849036:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849043:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849050:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849159:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be305872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849186:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be305872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849208:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be305872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837382.849219:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788837382.849358:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849367:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849373:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849379:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837382.849383:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849391:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849403:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837382.849407:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837382.849411:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849417:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167a800/0x843cbef8be305864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849430:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849435:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849450:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849454:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ae00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837382.849458:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849464:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849472:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb4556d500) 00010000:00010000:3.0:1788837382.849474:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837382.849477:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849482:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ae00/0x843cbef8be30586b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849522:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167ac00/0x843cbef8be30585d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb18 expref: 52 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849536:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be305872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb18 expref: 51 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.849544:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:3.0:1788837382.849546:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837382.849548:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb4167b800, rc 0) 00000100:00100000:3.0:1788837382.849617:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7594b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:10436:x1875731688754048:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 740us (3981us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788837382.849633:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:0.0:1788837382.857397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837382.857457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837382.857485:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688754304 00000100:00100000:0.0:1788837382.857501:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688754304 00000100:00100000:0.0:1788837382.857549:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1788837382.857558:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:2361:x1875731688754304:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837382.857573:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837382.857595:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b800/0x843cbef8be305872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb18 expref: 51 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837382.857613:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:0.0:1788837382.857618:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837382.857661:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:2361:x1875731688754304:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837382.857668:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1788837382.858573:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688754176 00000100:00100000:3.0:1788837382.858580:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688754176 00000100:00100000:3.0:1788837382.858619:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:3.0:1788837382.858628:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:10436:x1875731688754176:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1788837382.858684:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.858700:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.858710:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.858734:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.858741:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.858748:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.858755:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837382.858759:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.858767:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.858776:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:3.0:1788837382.858809:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837382.858815:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837382.858821:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837382.858876:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:10436:x1875731688754176:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 249us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837382.858883:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:0.0:1788837382.863397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.864147:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688754560 00000100:00100000:1.0:1788837382.864158:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688754560 00000100:00100000:1.0:1788837382.864416:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1788837382.864437:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:10436:x1875731688754560:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837382.864651:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:10436:x1875731688754560:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 216us (1261us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788837382.869584:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00010000:00010000:2.0:1788837382.885692:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837382.975528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837382.975587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.975799:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688754688 00000100:00100000:1.0:1788837382.975809:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688754688 00000100:00100000:1.0:1788837382.975864:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 281 00000100:00100000:1.0:1788837382.975875:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688754688:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837382.975940:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688754688:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 66us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837382.975947:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 281 00000100:00100000:3.0:1788837382.975986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837382.976011:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688754944 00000100:00100000:1.0:1788837382.976016:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688754944 00000100:00100000:1.0:1788837382.976052:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:1.0:1788837382.976059:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688754944:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:3.0:1788837382.976079:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837382.976093:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688754944:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837382.976099:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:0.0:1788837382.978403:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688754816 00000100:00100000:0.0:1788837382.978425:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688754816 00000100:00100000:0.0:1788837382.978507:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1788837382.978516:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688754816:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837382.978587:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688754816:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 71us (2998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837382.978595:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00080000:3.0:1788837382.979069:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837383.014400:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837383.014542:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837383.014562:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708702720:0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.014581:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708702464:0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.014640:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837383.014641:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837383.014700:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837383.014708:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708702592:0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.014735:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837383.014768:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708702464 00000100:00100000:3.0:1788837383.014775:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708702464 00000100:00100000:3.0:1788837383.014822:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708702592 00000100:00100000:3.0:1788837383.014825:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708702592 00000100:00080000:3.0:1788837383.014841:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837383.014861:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788837383.014869:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708702464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.014911:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708702464:12345-0@lo:400:kworker.0 Request processed in 43us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837383.014917:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788837383.014948:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708702464:0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.014981:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788837383.014987:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708702592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.015014:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708702592:12345-0@lo:400:kworker.0 Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837383.015019:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788837383.015036:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708702592:0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.015090:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708702720 00000100:00100000:3.0:1788837383.015093:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708702720 00000100:00100000:3.0:1788837383.015116:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788837383.015124:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708702720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.015148:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708702720:12345-0@lo:400:kworker.0 Request processed in 27us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837383.015153:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788837383.015164:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837383.015190:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708702848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837383.015222:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837383.015248:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708702720:0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.015270:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708702848 00000100:00100000:3.0:1788837383.015273:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708702848 00000100:00100000:3.0:1788837383.015297:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788837383.015320:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875731708702848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837383.015343:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837383.015371:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875731708702848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837383.015376:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788837383.015397:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837383.015416:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708702848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837383.015653:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708702336:0@lo:400:kworker.0 00000100:00100000:0.0:1788837383.015689:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837383.015776:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708702336 00000100:00100000:3.0:1788837383.015827:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708702336 00000100:00100000:3.0:1788837383.015862:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788837383.015868:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708702336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837383.015900:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708702336:12345-0@lo:400:kworker.0 Request processed in 32us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837383.015906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788837383.016246:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837383.016257:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708702976:0@lo:400:kworker.0 00000100:00100000:1.0:1788837383.016298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837383.016342:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708702976 00000100:00100000:1.0:1788837383.016346:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708702976 00000100:00100000:1.0:1788837383.016380:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788837383.016387:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708702976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837383.016421:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708702976:12345-0@lo:400:kworker.0 Request processed in 35us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837383.016427:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788837383.016455:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708702976:0@lo:400:kworker.0 00000100:00080000:1.0:1788837383.016469:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837383.016772:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708702336:0@lo:400:kworker.0 00000004:00080000:2.0:1788837383.019676:0:8101:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336870369393ns, next at 337870366916ns, rc = 0 00000100:00100000:3.0:1788837383.049847:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837383.049948:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688755200 00000100:00100000:0.0:1788837383.049958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688755200 00000100:00100000:0.0:1788837383.050028:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:0.0:1788837383.050038:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:10454:x1875731688755200:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:0.0:1788837383.050062:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837383.050082:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305887 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb1f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837383.050182:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be30588e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837383.050197:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be30588e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837383.050208:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be30588e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837383.050219:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788837383.050394:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305887 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb1f expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837383.050413:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be30588e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb1f expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837383.050422:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:0.0:1788837383.050425:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788837383.050429:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917aa00, rc 0) 00000100:00100000:0.0:1788837383.050491:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+53:10454:x1875731688755200:12345-192.168.203.43@tcp:101:cat.0 Request processed in 454us (653us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788837383.050498:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:2.0:1788837383.082461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837383.082552:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688755328 00000100:00100000:3.0:1788837383.082562:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688755328 00000100:00100000:3.0:1788837383.082624:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:3.0:1788837383.082634:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+53:10455:x1875731688755328:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837383.082656:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837383.082681:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be30589c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb26 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.082765:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be3058a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.082780:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be3058a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.082791:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be3058a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837383.082823:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788837383.082827:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837383.082852:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be3058a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.083036:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be30589c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb26 expref: 55 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.083056:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be3058a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb26 expref: 54 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.083065:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837383.083067:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837383.083071:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031a00, rc 0) 00000100:00100000:3.0:1788837383.083244:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:10455:x1875731688755328:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 611us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837383.083252:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:2.0:1788837383.100162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837383.100261:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688755712 00000100:00100000:1.0:1788837383.100271:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688755712 00000100:00100000:1.0:1788837383.100360:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1788837383.100371:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:10455:x1875731688755712:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837383.100689:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10455:x1875731688755712:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 319us (535us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788837383.100697:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1788837383.106831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837383.107206:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688755840 00000100:00100000:1.0:1788837383.107217:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688755840 00000100:00100000:1.0:1788837383.107416:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1788837383.107427:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10455:x1875731688755840:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:1.0:1788837383.107443:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788837383.107468:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb0a expref: 55 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837383.107492:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be30588e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb1f expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837383.107505:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be30573e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbacb expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837383.107515:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb45631e00) 00010000:00010000:1.0:1788837383.107525:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837383.107583:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:10455:x1875731688755840:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 158us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837383.107590:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1788837383.109488:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837383.110191:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688755968 00000100:00100000:0.0:1788837383.110201:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688755968 00000100:00100000:0.0:1788837383.110258:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:0.0:1788837383.110275:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:10455:x1875731688755968:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:0.0:1788837383.110716:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837383.110732:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837383.110744:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837383.112006:0:7291:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837383.112208:0:7291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788837383.112289:0:7291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788837383.112438:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:10455:x1875731688755968:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 2161us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837383.112449:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:0.0:1788837383.138780:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837383.138876:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688756096 00000100:00100000:3.0:1788837383.138885:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688756096 00000100:00100000:3.0:1788837383.138939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:3.0:1788837383.138951:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:10457:x1875731688756096:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837383.138972:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837383.138992:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be3058b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb2d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139056:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139068:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139410:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139426:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139434:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139439:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139522:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139532:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139539:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837383.139797:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788837383.139802:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837383.139822:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139834:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139843:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139860:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139866:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139872:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837383.139876:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139883:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139895:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837383.139898:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837383.139903:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139909:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be3058b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139922:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139929:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139936:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139940:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837383.139949:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139955:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139963:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb4556d500) 00010000:00010000:3.0:1788837383.139965:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837383.139968:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.139974:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be3058bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.140006:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be3058b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb2d expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.140019:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb2d expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837383.140026:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:3.0:1788837383.140029:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837383.140031:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030600, rc 0) 00000100:00100000:3.0:1788837383.140507:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+53:10457:x1875731688756096:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1557us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837383.140516:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000001:00080000:1.0:1788837383.636259:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:1.0:1788837383.636285:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:1.0:1788837383.636336:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788837383.636368:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788837383.636378:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9acb512d79c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788837383.636382:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb42dbb700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9acb6341f480 00000020:00080000:1.0:1788837383.636386:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb42dbbf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9acb47e6e800 00000020:00080000:1.0:1788837383.636795:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788837383.636905:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788837383.636923:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb50dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708703104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788837383.636983:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837383.637049:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708703104 00000100:00100000:1.0:1788837383.637662:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708703104 00000100:00100000:1.0:1788837383.637710:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837383.637719:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875731708703104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788837383.637745:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788837383.637923:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f7e05, atime: 0x6a9f7e05, ctime: 0x6a9f7e05, blocks: 0x1 00010000:00010000:1.0:1788837383.637932:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837383.637948:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1788837383.637952:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837383.637959:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837383.637976:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837383.637986:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837383.637993:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837383.638017:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837383.639351:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837383.639360:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837383.639373:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576e00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837383.639377:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837383.639386:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837383.639405:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837383.639430:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fb19526/0x843cbef8be3058cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837383.639451:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837383.639453:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837383.639455:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837383.639639:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875731708703104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1917us (2652us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788837383.639648:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1788837383.639736:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb50dcdc00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788837383.639743:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb50dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708703104:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788837383.909567:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788837384.010862:0:12005:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837384.010872:0:12005:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837384.010913:0:12005:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788837384.010920:0:12005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788837384.038497:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837384.038505:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837384.038562:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788837384.038574:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837384.038707:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f598000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708703232:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837384.038808:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837384.047494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837384.047532:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688756224 00000100:00100000:2.0:1788837384.047541:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688756224 00000100:00100000:2.0:1788837384.047598:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:2.0:1788837384.047610:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688756224:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788837384.047682:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688756224:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837384.047690:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1788837384.048150:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f598000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708703232:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1788837384.048562:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837384.058568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837384.058609:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688756352 00000100:00100000:0.0:1788837384.058619:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688756352 00000100:00100000:0.0:1788837384.058677:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:0.0:1788837384.058689:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:10468:x1875731688756352:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788837384.058719:0:11703:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788837384.059228:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:10468:x1875731688756352:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 539us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837384.059236:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:2.0:1788837384.066134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837384.066267:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688756480 00000100:00100000:1.0:1788837384.066277:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688756480 00000100:00100000:1.0:1788837384.066361:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1788837384.066372:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:10468:x1875731688756480:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788837384.066448:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066464:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066476:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066528:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066536:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066542:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066565:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066573:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066590:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837384.066625:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788837384.066629:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837384.066641:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066653:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066659:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066666:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066673:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837384.066678:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066686:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066697:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:1.0:1788837384.066700:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837384.066704:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066710:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be3058d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066732:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066738:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066745:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066751:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837384.066755:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066762:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066769:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9acb45631700) 00010000:00010000:1.0:1788837384.066771:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837384.066775:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066780:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3058db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066793:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066799:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066805:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066817:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837384.066820:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066827:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066837:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:1.0:1788837384.066839:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837384.066843:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.066849:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be3058e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837384.066927:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:10468:x1875731688756480:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 557us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837384.066936:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:2.0:1788837384.071815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837384.071899:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688756736 00000100:00100000:1.0:1788837384.071909:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688756736 00000100:00100000:1.0:1788837384.071970:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:1.0:1788837384.071982:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:10468:x1875731688756736:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837384.072002:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837384.072022:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3058e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb34 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072115:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072144:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072156:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837384.072423:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788837384.072766:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072774:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072781:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072786:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837384.072790:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072796:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072808:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:1.0:1788837384.072810:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837384.072815:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072821:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3058f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072880:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3058e9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb34 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072898:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:1.0:1788837384.072900:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837384.072904:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3058e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb34 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.072914:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576c00, rc 0) 00000100:00100000:1.0:1788837384.072982:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688756736:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1002us (1174us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788837384.072989:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:3.0:1788837384.076425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837384.076527:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688756864 00000100:00100000:1.0:1788837384.076537:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688756864 00000100:00100000:1.0:1788837384.076674:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:1.0:1788837384.076685:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688756864:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788837384.076732:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788837384.076836:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688756864:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 153us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837384.076844:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:3.0:1788837384.089772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837384.090064:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688757120 00000100:00100000:1.0:1788837384.090075:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688757120 00000100:00100000:1.0:1788837384.090241:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:1.0:1788837384.090254:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688757120:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837384.090274:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837384.090278:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788837384.090360:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be3058a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb26 expref: 12 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.090405:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:1.0:1788837384.090410:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837384.090423:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3058fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb3b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837384.091457:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788837384.091787:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.091805:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.091817:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.091882:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3058fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb3b expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.091901:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb3b expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.091910:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb45631700) 00010000:00010000:1.0:1788837384.091914:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837384.091917:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576a00, rc 0) 00000100:00100000:1.0:1788837384.091993:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10468:x1875731688757120:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1742us (2229us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788837384.092002:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:3.0:1788837384.096105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837384.107622:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688757376 00000100:00100000:2.0:1788837384.107635:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688757376 00000100:00100000:2.0:1788837384.107714:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:2.0:1788837384.107726:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10468:x1875731688757376:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788837384.107782:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837384.107807:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb3b expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.107827:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb45631700) 00010000:00010000:2.0:1788837384.107837:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837384.107860:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.107875:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.107885:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.107953:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.107961:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.107968:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108231:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108240:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108258:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108264:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837384.108269:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108277:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108286:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:2.0:1788837384.108290:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837384.108294:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108300:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305913 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108335:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108342:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108349:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108354:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837384.108358:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108498:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108509:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xbe98035 (ffff9acb454ceb00) 00010000:00010000:2.0:1788837384.108512:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837384.108516:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.108522:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be30591a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbe98035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837384.108609:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688757376:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 883us (12510us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837384.108617:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:3.0:1788837384.117439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837384.117521:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688757504 00000100:00100000:2.0:1788837384.117530:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688757504 00000100:00100000:2.0:1788837384.117587:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:2.0:1788837384.117598:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688757504:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837384.117618:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837384.117640:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305921 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb42 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.117676:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.117689:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.117700:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.117797:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb42 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.117814:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb42 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.117823:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:2.0:1788837384.117826:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837384.117830:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5200, rc 0) 00000100:00100000:2.0:1788837384.117883:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10468:x1875731688757504:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 286us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837384.117890:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:2.0:1788837384.120293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837384.120410:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688757760 00000100:00100000:3.0:1788837384.120419:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688757760 00000100:00100000:3.0:1788837384.120476:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:3.0:1788837384.120486:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10468:x1875731688757760:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837384.120556:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.120573:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.120585:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837384.120900:0:7291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788837384.120911:0:7291:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337971606050ns, next at 338971603539ns, rc = 0 00000004:00010000:3.0:1788837384.120999:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001eb8ac00 reply state 00000000a75624d1 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837384.121010:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837384.121128:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:10468:x1875731688757760:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 642us (841us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788837384.121141:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:3.0:1788837384.126520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:0.0:1788837384.126619:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.126631:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.126638:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.126644:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837384.126648:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.126656:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.126671:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:0.0:1788837384.126675:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788837384.126680:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.126686:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be30592f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837384.127366:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688757888 00000100:00100000:2.0:1788837384.127388:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688757888 00000100:00100000:2.0:1788837384.127440:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:2.0:1788837384.127451:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:10468:x1875731688757888:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837384.127473:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837384.127490:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb49 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.127548:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb49 expref: 15 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.127564:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb49 expref: 15 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.127601:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:2.0:1788837384.127604:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837384.127608:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4400, rc 0) 00000100:00100000:2.0:1788837384.127672:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:10468:x1875731688757888:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 222us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837384.127680:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:0.0:1788837384.133963:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837384.134050:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688758016 00000100:00100000:3.0:1788837384.134060:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688758016 00000100:00100000:3.0:1788837384.134108:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1788837384.134117:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875731688758016:12345-192.168.203.43@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788837384.134148:0:6701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:3.0:1788837384.134187:0:6701:0:(genops.c:1385:class_connect()) connect: client 4c93969d-0d98-4501-b440-fa8ca1cd6478, cookie 0x843cbef8be30593d 00002000:00100000:3.0:1788837384.134199:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c93969d-0d98-4501-b440-fa8ca1cd6478/ffff9acb7f694800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788837384.134223:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788837384.134646:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788837384.134676:0:6701:0:(import.c:65:import_set_state_nolock()) ffff9acb7f697000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837384.134751:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2357:x1875731688758016:12345-192.168.203.43@tcp:8:lhsmtool_posix.0 Request processed in 632us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837384.134817:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:0.0:1788837384.140018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837384.140200:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688758144 00000100:00100000:1.0:1788837384.140210:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688758144 00000100:00100000:1.0:1788837384.140285:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1788837384.140296:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:0:x1875731688758144:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788837384.140864:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788837384.231680:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1788837384.231698:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000100:00100000:0.0:1788837384.231789:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:0:x1875731688758144:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 91489us (91772us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788837384.231800:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1788837384.237635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837384.237716:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688758400 00000100:00100000:2.0:1788837384.237726:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688758400 00000100:00100000:2.0:1788837384.237780:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1788837384.237790:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:10468:x1875731688758400:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837384.238024:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:10468:x1875731688758400:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 234us (397us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788837384.238032:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1788837384.241141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837384.241254:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688758656 00000100:00100000:3.0:1788837384.241263:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688758656 00000100:00100000:3.0:1788837384.241343:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:3.0:1788837384.241354:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:10468:x1875731688758656:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788837384.241540:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:10468:x1875731688758656:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 187us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837384.241547:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:0.0:1788837384.244018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837384.244104:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688758784 00000100:00100000:3.0:1788837384.244113:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688758784 00000100:00100000:3.0:1788837384.244544:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:3.0:1788837384.244557:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:10468:x1875731688758784:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837384.244589:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837384.244611:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb50 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.244687:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be30594b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.244702:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be30594b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.244715:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be30594b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837384.244751:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837384.244771:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be30594b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.244795:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb50 expref: 18 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.244813:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be30594b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb50 expref: 17 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.244821:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:3.0:1788837384.244824:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788837384.244828:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031200, rc 0) 00000100:00100000:3.0:1788837384.244892:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:10468:x1875731688758784:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 338us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837384.244899:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:1.0:1788837384.258320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837384.258989:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688758912 00000100:00100000:3.0:1788837384.258999:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688758912 00000100:00100000:3.0:1788837384.259063:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:3.0:1788837384.259074:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688758912:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837384.259091:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837384.259115:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb57 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837384.259141:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7e09, blocks: 0x1 00010000:00010000:3.0:1788837384.259157:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1788837384.259162:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837384.259190:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb57 expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.259211:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb57 expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.259223:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031800, rc 0) 00000100:00100000:3.0:1788837384.259291:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688758912:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 219us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837384.259299:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:1.0:1788837384.264236:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837384.264354:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688759168 00000100:00100000:2.0:1788837384.264364:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688759168 00000100:00100000:2.0:1788837384.264411:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:2.0:1788837384.264420:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:10468:x1875731688759168:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788837384.264520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:10468:x1875731688759168:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 100us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837384.264528:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:2.0:1788837384.268953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837384.269471:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688759296 00000100:00100000:0.0:1788837384.269494:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688759296 00000100:00100000:0.0:1788837384.269612:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:0.0:1788837384.269623:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:10468:x1875731688759296:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837384.269643:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837384.269661:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb5e expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.269692:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb57 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.269702:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837384.269707:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837384.269712:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.269768:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb57 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.269782:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb57 expref: 7 pid: 6701 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837384.269795:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708703360:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837384.269890:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca432686c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837384.277382:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708703360:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837384.277423:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.277464:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917bc00, rc 0) 00000100:00100000:0.0:1788837384.277525:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:10468:x1875731688759296:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 7903us (8578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837384.277534:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:2.0:1788837384.277741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837384.277812:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688759424 00000100:00100000:0.0:1788837384.277820:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688759424 00010000:00010000:0.0:1788837384.277848:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb57 expref: 7 pid: 6701 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837384.277883:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1788837384.277893:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688759424:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837384.277908:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837384.277928:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb57 expref: 7 pid: 6701 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.277941:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb57 expref: 7 pid: 6701 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.277965:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a8012a/0x843cbef8be305952 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb57 expref: 7 pid: 6701 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.277979:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837384.277983:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837384.277991:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.278008:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.278042:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837384.278055:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875731708703488:192.168.203.43@tcp:105: 00000100:00100000:0.0:1788837384.278116:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca432686c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837384.281370:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875731708703488:192.168.203.43@tcp:105: 00010000:00010000:3.0:1788837384.281397:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837384.281453:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688759424:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 3561us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837384.281464:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1788837384.296532:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837384.296614:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688759552 00000100:00100000:1.0:1788837384.296623:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688759552 00002000:00100000:1.0:1788837384.296666:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9acb74e5ea00 x1875731688759552/t0(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:40/0 lens 504/0 e 0 to 0 dl 1788837395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837384.296675:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74e5ea00 with x1875731688759552 ext(0->8) 00002000:00010000:1.0:1788837384.296680:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb74e5ea00 00000100:00100000:1.0:1788837384.296708:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1788837384.296716:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688759552:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788837384.297503:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688759552:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 785us (978us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788837384.297511:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00002000:00100000:1.0:1788837384.297518:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9acb74e5ea00 x1875731688759552/t4294967302(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:40/0 lens 504/448 e 0 to 0 dl 1788837395 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837384.297527:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74e5ea00 with x1875731688759552 ext(0->8) 00002000:00010000:1.0:1788837384.297530:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb74e5ea00 00000100:00100000:1.0:1788837384.305549:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837384.305657:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688759680 00000100:00100000:2.0:1788837384.305667:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688759680 00000100:00100000:2.0:1788837384.305790:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:2.0:1788837384.305800:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:10468:x1875731688759680:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788837384.357321:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000100:00100000:3.0:1788837384.357332:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:10468:x1875731688759680:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 51527us (51786us total) trans 0 rc 0/0 00000020:00080000:0.0:1788837384.357341:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788837384.357343:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000001:00080000:0.0:1788837384.357354:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788837384.357361:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788837384.358287:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788837384.358335:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788837384.358692:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708703616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788837384.358739:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837384.358846:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708703616 00000100:00100000:0.0:1788837384.358854:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708703616 00000100:00100000:0.0:1788837384.358894:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788837384.358903:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708703616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788837384.359268:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788837384.359272:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788837385 00002000:00010000:0.0:1788837384.359274:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788837384.359276:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788837385 -> 1788837385 00002000:00010000:0.0:1788837384.359278:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788837384.359350:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875731708703616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 447us (608us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788837384.359371:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788837384.359876:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb74e5ca80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788837384.359882:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708703616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788837384.360939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837384.361025:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688759808 00000100:00100000:1.0:1788837384.361033:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688759808 00000100:00100000:1.0:1788837384.361137:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1788837384.361148:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688759808:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788837384.389019:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688759808:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 27862us (28074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837384.389033:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000001:00080000:1.0:1788837384.389087:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788837384.389097:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788837384.391394:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837384.391531:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688760064 00000100:00100000:3.0:1788837384.391543:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688760064 00000100:00100000:3.0:1788837384.391598:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:3.0:1788837384.391607:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10468:x1875731688760064:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837384.391666:0:7291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837384.391694:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be30594b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb50 expref: 13 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.391715:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:3.0:1788837384.391722:0:7291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837384.391751:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.391766:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.391776:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837384.392016:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008833bd88 reply state 00000000a0edfe56 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837384.392025:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837384.392711:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:10468:x1875731688760064:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1101us (1322us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788837384.392736:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:2.0:1788837384.399556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:1.0:1788837384.399637:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.399649:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.399656:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.399663:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837384.399668:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.399675:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.399691:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:1.0:1788837384.399694:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837384.399697:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.399721:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305960 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837384.399789:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688760192 00000100:00100000:0.0:1788837384.399798:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688760192 00000100:00100000:0.0:1788837384.399844:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:0.0:1788837384.399852:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688760192:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788837384.400079:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788837384.400083:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788837385 -> 1788837383 00002000:00010000:0.0:1788837384.400086:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788837381 00002000:00010000:0.0:1788837384.400088:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788837385 -> 1788837383 00002000:00010000:0.0:1788837384.400090:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788837384.400148:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688760192:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 296us (600us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788837384.400155:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:1.0:1788837384.403993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837384.404164:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688760448 00000100:00100000:3.0:1788837384.404189:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688760448 00000100:00100000:3.0:1788837384.404247:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:3.0:1788837384.404257:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10468:x1875731688760448:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788837384.404362:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.404389:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb42 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.404399:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.404433:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb42 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.404448:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb42 expref: 13 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837384.404461:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f59ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708703744:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837384.404546:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837384.412612:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f59ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708703744:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837384.412644:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837384.412955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837384.413051:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688760576 00000100:00100000:0.0:1788837384.413058:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688760576 00010000:00010000:0.0:1788837384.413097:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb42 expref: 14 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837384.413135:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:0.0:1788837384.413144:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:2361:x1875731688760576:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837384.413157:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837384.413164:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb42 expref: 14 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.413189:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb42 expref: 14 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.413230:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305928 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb42 expref: 14 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.413247:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:0.0:1788837384.413252:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.413261:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.413269:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.413289:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837384.413611:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:2361:x1875731688760576:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 467us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837384.413619:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00010000:00010000:2.0:1788837384.415147:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.415163:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.415205:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.415213:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.415219:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.415224:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837384.415283:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.415293:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.415341:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:2.0:1788837384.415344:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788837384.415349:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.415356:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305967 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837384.415445:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688760448:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 11188us (11459us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788837384.415580:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:1.0:1788837384.417776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837384.417853:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688760704 00000100:00100000:0.0:1788837384.417862:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688760704 00000100:00100000:0.0:1788837384.417913:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:0.0:1788837384.417922:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688760704:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788837384.417959:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.417976:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.418000:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837384.418004:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837384.418008:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.418050:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.418065:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 7 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837384.418079:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708703872:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837384.418155:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837384.422749:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837384.422827:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688760832 00000100:00100000:2.0:1788837384.422836:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688760832 00010000:00010000:2.0:1788837384.422881:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 8 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837384.422926:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:2.0:1788837384.422937:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688760832:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837384.422953:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837384.422977:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 8 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.422991:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 8 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.423018:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837384.423023:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837384.423042:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.423052:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.423073:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837384.423132:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688760832:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 197us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837384.423140:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00010000:00010000:1.0:1788837384.424295:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be305959 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb5e expref: 7 pid: 6698 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837384.424340:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708703872:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837384.424367:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.424379:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.424385:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.424419:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.424428:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.424436:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.424455:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ae00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837384.424459:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.424468:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.424484:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837384.424491:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be30596e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837384.424563:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688760704:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 6641us (6792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837384.424571:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:0.0:1788837384.436688:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837384.436779:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688761088 00000100:00100000:3.0:1788837384.436804:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688761088 00000100:00100000:3.0:1788837384.436867:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:3.0:1788837384.436878:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:10468:x1875731688761088:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837384.436968:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.436987:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.436998:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.437231:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.437243:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb49 expref: 13 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.437252:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.437285:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb49 expref: 13 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.437299:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb49 expref: 13 pid: 11703 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837384.437363:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f59ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875731708704000:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837384.437456:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837384.441907:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f59ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875731708704000:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837384.441948:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837384.445472:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837384.445574:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688761216 00000100:00100000:2.0:1788837384.445583:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688761216 00010000:00010000:2.0:1788837384.445626:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb49 expref: 14 pid: 11703 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837384.445681:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:2.0:1788837384.445693:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:2361:x1875731688761216:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837384.445707:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837384.445714:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb49 expref: 14 pid: 11703 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.445728:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb49 expref: 14 pid: 11703 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.445750:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305936 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb49 expref: 14 pid: 11703 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.445766:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:2.0:1788837384.445785:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.445795:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.445802:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.445888:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837384.445950:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:2361:x1875731688761216:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 259us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837384.445958:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00010000:00010000:3.0:1788837384.447649:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.447663:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837384.450496:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788837384.450663:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788837384.450702:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788837384.451070:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875731708704128:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788837384.451144:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837384.451253:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837384.451386:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708704128 00000100:00100000:3.0:1788837384.451393:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708704128 00000100:00100000:3.0:1788837384.451462:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837384.451472:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875731708704128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788837384.451565:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875731708704128:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837384.451573:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837384.451593:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788837384.451598:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb74e5ca80, transno 4294967303 00000100:00100000:2.0:1788837384.451615:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875731708704128:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788837384.452002:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788837384.452056:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75242680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875731708704256:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788837384.452083:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837384.452110:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837384.452287:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708704256 00000100:00100000:3.0:1788837384.452292:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708704256 00000100:00100000:3.0:1788837384.452434:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837384.452442:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875731708704256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788837384.452691:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875731708704256:12345-0@lo:1000:mdt00_001.0 Request processed in 249us (606us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788837384.452699:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837384.452721:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75242680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875731708704256:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788837384.452753:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.452769:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.452777:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.452783:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837384.452788:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.452796:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.452813:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:2.0:1788837384.452816:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837384.452821:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.452826:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be30597c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.452865:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.452871:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.452877:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.453732:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ac00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837384.453745:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.453753:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.453765:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:2.0:1788837384.453768:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837384.453772:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.453779:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3058aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.453830:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.453845:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb2d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.453852:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.453882:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb2d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.453896:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb2d expref: 16 pid: 5844 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837384.453908:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75243100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875731708704384:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837384.453973:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837384.462386:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75243100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875731708704384:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837384.462416:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837384.471963:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837384.472293:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688761344 00000100:00100000:3.0:1788837384.472343:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688761344 00010000:00010000:3.0:1788837384.472379:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb2d expref: 17 pid: 5844 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837384.472423:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1788837384.472449:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:2360:x1875731688761344:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837384.472463:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837384.472471:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb2d expref: 17 pid: 5844 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.472483:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb2d expref: 17 pid: 5844 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.472504:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3058c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb2d expref: 17 pid: 5844 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.472520:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:3.0:1788837384.472526:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.472536:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.472544:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.472569:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837384.472622:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:2360:x1875731688761344:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 174us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837384.472630:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00010000:00010000:0.0:1788837384.473029:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473038:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473051:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473056:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473071:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473242:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837384.473248:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473256:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473267:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837384.473270:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837384.473274:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473280:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305983 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473292:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473298:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473336:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473343:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837384.473346:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473364:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473374:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837384.473377:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788837384.473381:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837384.473386:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305975 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837384.473598:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:10468:x1875731688761088:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 36721us (36920us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788837384.473607:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00000020:00080000:0.0:1788837384.473611:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788837384.474275:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837384.474280:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837384.474337:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788837384.474345:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837384.480811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837384.480905:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688761600 00000100:00100000:2.0:1788837384.480915:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688761600 00000100:00100000:2.0:1788837384.480984:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1788837384.480996:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:10468:x1875731688761600:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788837384.481725:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788837384.481821:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788837384.481865:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.481883:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.481894:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.481903:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.481910:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.481916:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837384.481942:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788837384.482033:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:10468:x1875731688761600:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 1039us (1230us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788837384.482052:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000020:00080000:2.0:1788837384.482057:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837384.482103:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837384.482110:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.482128:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837384.482132:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.482153:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.482172:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9acb454ceb00) 00010000:00010000:3.0:1788837384.482175:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788837384.482180:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.482185:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be30598a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837384.482201:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837384.482203:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837384.482205:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837384.933838:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837385.061533:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708704512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837385.061606:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837385.061863:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708704512 00000100:00100000:1.0:1788837385.061878:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708704512 00000100:00100000:1.0:1788837385.061940:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837385.061950:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875731708704512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837385.061970:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788837385.062030:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875731708704512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837385.062037:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788837385.062176:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708704512:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837385.062229:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788837385.518186:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837385.518194:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837385.518245:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788837385.518253:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788837385.798537:0:12058:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837385.798547:0:12058:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837385.798585:0:12058:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788837385.798590:0:12058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837385.912900:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837385.912970:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688761856 00000100:00100000:2.0:1788837385.912980:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688761856 00000100:00100000:2.0:1788837385.913035:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:2.0:1788837385.913046:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:10486:x1875731688761856:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837385.913069:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837385.913088:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305991 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb65 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.913217:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305998 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.913231:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.913243:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837385.913255:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788837385.913398:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305991 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb65 expref: 20 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.913415:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305998 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb65 expref: 19 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.913434:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:2.0:1788837385.913437:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837385.913441:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5c00, rc 0) 00000100:00100000:2.0:1788837385.913496:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:10486:x1875731688761856:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 452us (601us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788837385.913502:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:1.0:1788837385.920573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837385.920650:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688761984 00000100:00100000:2.0:1788837385.920659:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688761984 00000100:00100000:2.0:1788837385.920712:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:2.0:1788837385.920723:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:10486:x1875731688761984:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:2.0:1788837385.920794:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.920810:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.920821:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.920836:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.920843:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.920848:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921056:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921071:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921079:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837385.921115:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921127:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921133:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921139:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921145:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837385.921150:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921169:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921181:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:2.0:1788837385.921184:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837385.921189:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921194:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be3059a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921225:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921231:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921236:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921241:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837385.921244:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921249:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921255:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb454ce400) 00010000:00010000:2.0:1788837385.921258:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837385.921260:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921265:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921277:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921283:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921289:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921300:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837385.921330:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921337:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921345:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb454cec00) 00010000:00010000:2.0:1788837385.921347:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837385.921349:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.921353:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be3059b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837385.921592:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:10486:x1875731688761984:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 869us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837385.921601:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00010000:00010000:3.0:1788837385.958325:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837385.969572:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837385.971927:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688762240 00000100:00100000:0.0:1788837385.971939:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688762240 00000100:00100000:0.0:1788837385.971994:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:0.0:1788837385.972004:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:10489:x1875731688762240:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837385.972022:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837385.972041:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3059bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972107:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972122:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972144:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972173:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972181:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972189:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972459:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972468:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972475:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837385.972484:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788837385.972571:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972578:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972584:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972589:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ac00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837385.972601:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972608:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972620:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:0.0:1788837385.972623:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837385.972627:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972634:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3059c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972645:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972651:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972656:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972661:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ba00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837385.972665:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972670:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972678:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb50df5500) 00010000:00010000:0.0:1788837385.972680:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837385.972689:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972694:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972731:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3059bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb6c expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972745:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb6c expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837385.972751:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:0.0:1788837385.972753:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837385.972755:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917ae00, rc 0) 00000100:00100000:0.0:1788837385.972816:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:10489:x1875731688762240:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 814us (3252us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788837385.972824:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:2.0:1788837385.987754:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837385.987856:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688762368 00000100:00100000:2.0:1788837385.987865:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688762368 00000100:00100000:2.0:1788837385.987913:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:2.0:1788837385.987923:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:10489:x1875731688762368:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1788837385.987980:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.987997:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.988018:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.988042:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.988049:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.988055:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.988062:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837385.988067:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.988074:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.988086:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:2.0:1788837385.988089:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837385.988093:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837385.988099:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be3059de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837385.988171:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:10489:x1875731688762368:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 248us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837385.988178:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:1.0:1788837385.994244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837385.996240:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688762624 00000100:00100000:2.0:1788837385.996254:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688762624 00000100:00100000:2.0:1788837385.997554:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1788837385.997572:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db2e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:10489:x1875731688762624:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1788837385.997789:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db2e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:10489:x1875731688762624:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 222us (3554us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788837385.997797:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1788837386.045370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.046705:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688762880 00000100:00100000:0.0:1788837386.046717:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688762880 00000100:00100000:0.0:1788837386.046800:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:0.0:1788837386.046810:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:10010:x1875731688762880:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837386.046847:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837386.046866:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3059e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb73 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.046966:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.046996:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb6c expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.047005:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.047036:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb6c expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.047050:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb6c expref: 23 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.047076:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708704640:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837386.047179:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca432680c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788837386.047246:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837386.051908:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708704640:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837386.051942:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837386.062096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.062207:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688763008 00000100:00100000:0.0:1788837386.062217:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688763008 00010000:00010000:0.0:1788837386.062255:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb6c expref: 24 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.062299:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:0.0:1788837386.062356:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:2360:x1875731688763008:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837386.062370:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837386.062389:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb6c expref: 24 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.062402:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb6c expref: 24 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.062422:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be3059d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb6c expref: 24 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.062544:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:0.0:1788837386.062549:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.062559:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.062567:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837386.063698:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837386.063764:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75243480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:2360:x1875731688763008:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 1406us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837386.063774:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00010000:00010000:0.0:1788837386.064652:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.064664:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837386.064683:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788837386.064833:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3059e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb73 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.064851:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb73 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.064876:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:0.0:1788837386.064878:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837386.064882:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917ba00, rc 0) 00000100:00100000:0.0:1788837386.064931:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:10010:x1875731688762880:12345-192.168.203.43@tcp:101:bash.0 Request processed in 18122us (19569us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788837386.064938:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:2.0:1788837386.078181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.079534:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688763264 00000100:00100000:3.0:1788837386.079546:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688763264 00000100:00100000:3.0:1788837386.079609:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:3.0:1788837386.079620:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:10010:x1875731688763264:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:3.0:1788837386.079966:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.079983:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.079996:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837386.080189:0:7291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788837386.080216:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000431f9fde reply state 00000000d15014da transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837386.080224:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788837386.080710:0:7291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788837386.081351:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:10010:x1875731688763264:12345-192.168.203.43@tcp:36:bash.0 Request processed in 1729us (3175us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788837386.082523:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 89 00000020:00080000:3.0:1788837386.082533:0:7291:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788837386.091248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:1.0:1788837386.091504:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.091517:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.091524:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.091530:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837386.091534:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.091541:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.091557:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:1.0:1788837386.091560:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837386.091564:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.091570:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be3059fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837386.091700:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688763392 00000100:00100000:1.0:1788837386.091710:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688763392 00000100:00100000:1.0:1788837386.091793:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:1.0:1788837386.091803:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:10010:x1875731688763392:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1788837386.091827:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837386.091844:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305a01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb7a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.091899:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305a01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb7a expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.091914:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305a01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb7a expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.091933:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:1.0:1788837386.091937:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837386.091940:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576c00, rc 0) 00000100:00100000:1.0:1788837386.091996:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:10010:x1875731688763392:12345-192.168.203.43@tcp:101:bash.0 Request processed in 194us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837386.092003:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:2.0:1788837386.098799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.098896:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688763520 00000100:00100000:0.0:1788837386.098906:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688763520 00000100:00100000:0.0:1788837386.099218:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1788837386.099232:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:10010:x1875731688763520:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837386.099249:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837386.099270:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb81 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837386.099294:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f7e07, atime: 0x6a9f7e05, ctime: 0x6a9f7e07, blocks: 0xb 00010000:00010000:0.0:1788837386.099336:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788837386.099342:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837386.099351:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb81 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.099370:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb81 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.099383:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917b200, rc 0) 00000100:00100000:0.0:1788837386.099454:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:10010:x1875731688763520:12345-192.168.203.43@tcp:101:bash.0 Request processed in 226us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.099461:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00080000:0.0:1788837386.099485:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837386.103763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.103948:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688763648 00000100:00100000:3.0:1788837386.103957:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688763648 00002000:00010000:3.0:1788837386.103994:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788837386.103998:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb75243800 with x1875731688763648 ext(0->18446744073709551615) 00002000:00010000:3.0:1788837386.104010:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb75243800. 00000100:00100000:3.0:1788837386.104043:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1788837386.104053:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688763648:12345-192.168.203.43@tcp:10:bash.0 00002000:00010000:3.0:1788837386.104362:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788837386.104366:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788837383 -> 1788837387 00002000:00010000:3.0:1788837386.104368:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788837381 -> 1788837381 00002000:00010000:3.0:1788837386.104370:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788837383 -> 1788837387 00002000:00010000:3.0:1788837386.104372:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788837386.104423:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688763648:12345-192.168.203.43@tcp:10:bash.0 Request processed in 371us (668us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788837386.104431:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00002000:00010000:3.0:1788837386.104434:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788837386.104436:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb75243800 with x1875731688763648 ext(0->18446744073709551615) 00002000:00010000:3.0:1788837386.104440:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb75243800. 00000001:00080000:2.0:1788837386.132605:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1788837386.132644:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788837386.240345:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.240512:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688763776 00000100:00100000:0.0:1788837386.240522:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688763776 00000100:00100000:0.0:1788837386.240581:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:0.0:1788837386.240592:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:10504:x1875731688763776:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1788837386.240660:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.240677:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.240689:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.240703:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.240710:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.240717:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241082:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241093:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241110:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837386.241146:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241166:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241172:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241178:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241183:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ae00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837386.241187:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241193:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241204:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:0.0:1788837386.241206:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837386.241210:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241216:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305a0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241227:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241237:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241243:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241247:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ac00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837386.241250:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241255:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241261:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb50df5900) 00010000:00010000:0.0:1788837386.241264:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837386.241266:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241272:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305a16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241284:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241289:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241294:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241298:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837386.241349:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241355:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241363:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:0.0:1788837386.241365:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837386.241368:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.241374:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305a1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.241854:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:10504:x1875731688763776:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1252us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.241864:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:2.0:1788837386.295690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.295780:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688764032 00000100:00100000:3.0:1788837386.295790:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688764032 00000100:00100000:3.0:1788837386.295875:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:3.0:1788837386.295885:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:10507:x1875731688764032:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837386.295905:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837386.295923:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb88 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.295986:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.296000:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.296010:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.296039:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.296046:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.296052:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.296349:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305a39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.296359:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.296366:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837386.296383:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788837386.296985:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.296995:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297002:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297008:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837386.297012:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297032:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297044:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837386.297047:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837386.297051:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297056:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297068:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297074:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297079:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297083:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837386.297085:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297090:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297096:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb4556d500) 00010000:00010000:3.0:1788837386.297098:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837386.297100:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297114:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297166:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb88 expref: 30 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297182:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305a39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb88 expref: 29 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.297189:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:3.0:1788837386.297191:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788837386.297193:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031200, rc 0) 00000100:00100000:3.0:1788837386.297264:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:10507:x1875731688764032:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1380us (1583us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788837386.297272:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:2.0:1788837386.302111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837386.302294:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688764160 00000100:00100000:1.0:1788837386.302333:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688764160 00000100:00100000:1.0:1788837386.302510:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:1.0:1788837386.302521:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:10507:x1875731688764160:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:1.0:1788837386.302588:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.302622:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb73 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.302632:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.302667:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb73 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.303351:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb73 expref: 29 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837386.303368:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79632d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708704768:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837386.303479:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50f9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837386.315513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837386.316292:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79632d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708704768:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837386.316350:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837386.318014:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688764416 00000100:00100000:3.0:1788837386.318027:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688764416 00000100:00100000:3.0:1788837386.318102:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1788837386.318113:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+30:9975:x1875731688764416:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788837386.318469:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:9975:x1875731688764416:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 357us (2965us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788837386.318478:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:0.0:1788837386.325247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.325974:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688764544 00000100:00100000:3.0:1788837386.325985:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688764544 00010000:00010000:3.0:1788837386.326021:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb73 expref: 31 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837386.326085:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:3.0:1788837386.326094:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:2360:x1875731688764544:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837386.326107:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837386.326114:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb73 expref: 31 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.326125:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb73 expref: 31 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.326145:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be3059ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb73 expref: 31 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.326169:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:3.0:1788837386.326175:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.326184:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.326192:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.326219:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837386.326273:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+30:2360:x1875731688764544:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 180us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837386.326280:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00010000:00010000:1.0:1788837386.326936:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.326946:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.326972:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.326979:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.326993:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.326999:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837386.327003:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.327010:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.327020:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:1.0:1788837386.327022:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837386.327026:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.327032:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837386.327092:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:10507:x1875731688764160:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 24573us (24989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837386.327099:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:0.0:1788837386.332997:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.333397:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688764800 00000100:00100000:3.0:1788837386.333421:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688764800 00000100:00100000:3.0:1788837386.333489:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1788837386.333499:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:10507:x1875731688764800:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1788837386.333912:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+30:10507:x1875731688764800:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 413us (923us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788837386.333921:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:0.0:1788837386.432418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837386.432567:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688765056 00000100:00100000:1.0:1788837386.432577:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688765056 00000100:00100000:1.0:1788837386.432645:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:1.0:1788837386.432655:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+30:10518:x1875731688765056:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:1.0:1788837386.432678:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837386.432708:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb8f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.432801:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.432816:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.432826:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.432842:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.432849:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.432857:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433099:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433108:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433115:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837386.433124:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788837386.433224:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433231:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433246:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433252:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837386.433256:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433263:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433276:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:1.0:1788837386.433279:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837386.433283:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433289:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433299:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433348:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433353:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433358:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837386.433360:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433376:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433385:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb45631200) 00010000:00010000:1.0:1788837386.433387:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837386.433390:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433395:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433446:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305a4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb8f expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433460:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb8f expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.433467:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:1.0:1788837386.433470:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837386.433472:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577200, rc 0) 00000100:00100000:1.0:1788837386.433537:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:10518:x1875731688765056:12345-192.168.203.43@tcp:101:cat.0 Request processed in 884us (1128us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788837386.433545:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:0.0:1788837386.439775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.439829:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688765312 00000100:00100000:3.0:1788837386.439839:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688765312 00000100:00100000:3.0:1788837386.439898:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1788837386.439909:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:10518:x1875731688765312:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:3.0:1788837386.440146:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+33:10518:x1875731688765312:12345-192.168.203.43@tcp:35:cat.0 Request processed in 238us (379us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788837386.440200:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1788837386.462420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.462512:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688765568 00000100:00100000:3.0:1788837386.462522:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688765568 00000100:00100000:3.0:1788837386.462576:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:3.0:1788837386.462585:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+33:10519:x1875731688765568:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:3.0:1788837386.462654:0:7291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788837386.462680:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577200/0x843cbef8be305a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb8f expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.462710:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305a39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb88 expref: 32 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.462724:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305a01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb7a expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.462751:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:3.0:1788837386.462762:0:7291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837386.462782:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.462794:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.462803:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.462816:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.462822:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.462829:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463054:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463062:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463069:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837386.463701:0:7291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788837386.463711:0:7291:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340314406471ns, next at 341314404299ns, rc = 0 00010000:00010000:3.0:1788837386.463776:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463787:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463794:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463801:0:7291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463807:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463814:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463831:0:7291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837386.463849:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463855:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463861:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463867:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837386.463871:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463879:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463897:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb4556da00) 00010000:00010000:3.0:1788837386.463900:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788837386.463905:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463910:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305a7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463926:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463932:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463938:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463942:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837386.463945:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463950:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463956:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837386.463958:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837386.463962:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.463966:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305a71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837386.463987:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000759d864d reply state 00000000058e8ba9 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837386.463995:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837386.464082:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:10519:x1875731688765568:12345-192.168.203.43@tcp:36:rm.0 Request processed in 1495us (1669us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788837386.464089:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 95 00010000:00010000:0.0:1788837386.465030:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837386.465039:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.465049:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030a00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837386.465053:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.465072:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.465097:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9acb4556da00) 00010000:00010000:0.0:1788837386.465100:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788837386.465104:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.465109:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305a86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.465125:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837386.465127:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837386.465128:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837386.467793:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.467811:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.467835:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.467841:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837386.467845:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.467853:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.467868:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb4556d500) 00010000:00010000:1.0:1788837386.467871:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837386.467875:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.467880:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305a78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.528104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837386.528218:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688765824 00000100:00100000:1.0:1788837386.528229:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688765824 00000100:00100000:1.0:1788837386.528291:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:1.0:1788837386.528328:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:10525:x1875731688765824:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1788837386.528353:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837386.528390:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb96 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.528726:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.528757:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.528769:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.528785:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.528792:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.528799:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837386.529347:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788837386.531287:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.535567:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.535590:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.536125:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.536135:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.536141:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.536170:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837386.536174:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.536182:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.536196:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:1.0:1788837386.536199:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837386.536204:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.536210:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305a94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837386.536225:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022963ff2 reply state 00000000a56eeb1d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837386.536235:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788837386.536280:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305a8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb96 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.536295:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb96 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.536345:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb45631000) 00010000:00010000:1.0:1788837386.536349:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837386.536352:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577c00, rc 0) 00000100:00100000:1.0:1788837386.537009:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:10525:x1875731688765824:12345-192.168.203.43@tcp:101:bash.0 Request processed in 8705us (8910us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788837386.537027:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 96 00010000:00010000:1.0:1788837386.540948:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.540964:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.540972:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.540978:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837386.540982:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.540990:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.541005:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb45631200) 00010000:00010000:1.0:1788837386.541008:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837386.541012:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.541018:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305a9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.543150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837386.543680:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688765952 00000100:00100000:1.0:1788837386.543867:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688765952 00000100:00100000:2.0:1788837386.544607:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:2.0:1788837386.544627:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688765952:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1788837386.544644:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837386.544675:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbb9d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837386.544708:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788837386.544726:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1788837386.544731:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837386.544740:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb9d expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837386.544759:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb9d expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837386.544773:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4400, rc 0) 00000100:00100000:2.0:1788837386.544839:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688765952:12345-192.168.203.43@tcp:101:bash.0 Request processed in 224us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837386.544845:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00080000:0.0:1788837386.549171:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837386.558866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.558962:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688766080 00000100:00100000:3.0:1788837386.558972:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688766080 00000100:00100000:3.0:1788837386.559031:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:3.0:1788837386.559042:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:10525:x1875731688766080:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1788837386.559067:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837386.559084:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbba4 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.559116:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb9d expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.559125:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837386.559129:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837386.559134:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.559180:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb9d expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.559214:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb9d expref: 7 pid: 6700 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837386.559229:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f59b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1875731708704896:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837386.559367:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837386.561190:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f59b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1875731708704896:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837386.561219:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.561237:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030600, rc 0) 00000100:00100000:0.0:1788837386.561293:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:10525:x1875731688766080:12345-192.168.203.43@tcp:101:bash.0 Request processed in 2253us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.561300:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:0.0:1788837386.567943:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837386.568041:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688766208 00000100:00100000:1.0:1788837386.568051:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688766208 00010000:00010000:1.0:1788837386.568160:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb9d expref: 7 pid: 6700 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837386.568224:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:1.0:1788837386.568235:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688766208:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837386.568251:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837386.568273:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb9d expref: 7 pid: 6700 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.568286:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb9d expref: 7 pid: 6700 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.568344:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4f91155/0x843cbef8be305ab0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb9d expref: 7 pid: 6700 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.568361:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837386.568365:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837386.568993:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.569008:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.569047:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837386.569126:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79632d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875731708705024:192.168.203.43@tcp:105: 00000100:00100000:2.0:1788837386.569495:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50f9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837386.578261:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79632d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875731708705024:192.168.203.43@tcp:105: 00010000:00010000:0.0:1788837386.578288:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837386.578389:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688766208:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 10155us (10454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.578414:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:3.0:1788837386.584484:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837386.585222:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688766464 00000100:00100000:2.0:1788837386.585232:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688766464 00000100:00100000:2.0:1788837386.585333:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1788837386.585345:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+33:10525:x1875731688766464:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:2.0:1788837386.586532:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:10525:x1875731688766464:12345-192.168.203.43@tcp:35:bash.0 Request processed in 1185us (2050us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788837386.586543:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1788837386.778362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.778814:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688766592 00000100:00100000:0.0:1788837386.778824:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688766592 00000100:00100000:0.0:1788837386.778881:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:0.0:1788837386.778892:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:10541:x1875731688766592:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837386.778917:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837386.778936:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbab expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.778998:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.779011:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.779021:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837386.779053:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788837386.779056:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837386.779073:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.779097:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbab expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.779114:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbab expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.779875:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:0.0:1788837386.779878:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837386.779882:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917be00, rc 0) 00000100:00100000:0.0:1788837386.779947:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:10541:x1875731688766592:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1055us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.779954:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:0.0:1788837386.784610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.784926:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688766848 00000100:00100000:3.0:1788837386.784937:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688766848 00000100:00100000:3.0:1788837386.784999:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:3.0:1788837386.785009:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:10541:x1875731688766848:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837386.785029:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837386.785048:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbb2 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.785171:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305ad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.785186:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.785197:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837386.785208:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788837386.785482:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbb2 expref: 38 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.785825:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbb2 expref: 37 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.785836:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb45631000) 00010000:00010000:3.0:1788837386.785839:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837386.785842:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031200, rc 0) 00000100:00100000:3.0:1788837386.785955:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:10541:x1875731688766848:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 947us (1354us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788837386.785962:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:3.0:1788837386.802091:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.802648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.803279:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688767232 00000100:00100000:1.0:1788837386.803283:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688767104 00000100:00100000:1.0:1788837386.803290:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688767104 00000100:00100000:0.0:1788837386.803290:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688767232 00000100:00100000:1.0:1788837386.803366:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:0.0:1788837386.803366:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1788837386.803375:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:10541:x1875731688767104:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837386.803395:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837386.803416:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305ae1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbb9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.803472:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+39:2358:x1875731688767232:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837386.803483:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837386.803504:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305ad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbb2 expref: 39 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.803509:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ae8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.803522:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb45631000) 00010000:00010000:0.0:1788837386.803527:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837386.803583:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:2358:x1875731688767232:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 208us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.803591:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00010000:00010000:1.0:1788837386.803655:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.803677:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837386.803752:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788837386.803878:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305ae1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbb9 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.803893:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbb9 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.803901:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb45631000) 00010000:00010000:1.0:1788837386.803904:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788837386.803906:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577000, rc 0) 00000100:00100000:1.0:1788837386.803983:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:10541:x1875731688767104:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 609us (1908us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788837386.804006:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:3.0:1788837386.816490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.816631:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688767360 00000100:00100000:0.0:1788837386.816641:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688767360 00000100:00100000:0.0:1788837386.816713:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:0.0:1788837386.816723:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688767360:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:0.0:1788837386.816766:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.816800:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.816807:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837386.816811:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837386.816816:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.816852:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.816865:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 6 pid: 6701 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.816879:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875731708705152:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837386.820654:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837386.822584:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875731708705152:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837386.822616:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837386.823441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837386.823615:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688767488 00000100:00100000:1.0:1788837386.823623:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688767488 00002000:00100000:1.0:1788837386.823683:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9acb7f598380 x1875731688767488/t0(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:42/0 lens 504/0 e 0 to 0 dl 1788837397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837386.823700:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb7f598380 with x1875731688767488 ext(0->8) 00010000:00010000:1.0:1788837386.823709:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 7 pid: 6701 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.823725:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 7 pid: 6701 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837386.823733:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9acb7f598380 00000100:00100000:1.0:1788837386.823763:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1788837386.823774:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688767488:12345-192.168.203.43@tcp:4:lfs.0 00000100:00100000:1.0:1788837386.824945:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688767488:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 1166us (1500us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788837386.824955:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00002000:00100000:1.0:1788837386.824964:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9acb7f598380 x1875731688767488/t4294967302(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:42/0 lens 504/448 e 0 to 0 dl 1788837397 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837386.824972:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb7f598380 with x1875731688767488 ext(0->8) 00010000:00010000:1.0:1788837386.824980:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 9 pid: 6701 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.825008:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 9 pid: 6701 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837386.825015:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9acb7f598380 00000100:00100000:2.0:1788837386.835982:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.837845:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688767616 00000100:00100000:0.0:1788837386.837863:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688767616 00010000:00010000:0.0:1788837386.837907:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 9 pid: 6701 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.837972:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:0.0:1788837386.837983:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2359:x1875731688767616:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837386.837998:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788837386.838016:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788837386.838019:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788837387 00002000:00010000:0.0:1788837386.838021:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788837387 00002000:00010000:0.0:1788837386.838023:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788837387 00010000:00010000:0.0:1788837386.838028:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 9 pid: 6701 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.838042:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 9 pid: 6701 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.838063:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090572399/0x843cbef8be305ab7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbba4 expref: 9 pid: 6701 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.838206:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837386.838211:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837386.838217:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.838228:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.838384:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837386.838450:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2359:x1875731688767616:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 469us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.838457:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00010000:00010000:1.0:1788837386.841091:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.841116:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.841161:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.841171:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.841180:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.841187:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ba00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837386.841191:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.841201:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.841241:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.841249:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7949ad5/0x843cbef8be305af6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837386.841354:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688767360:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 24629us (24868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837386.841364:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:2.0:1788837386.845143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837386.845238:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688767872 00000100:00100000:3.0:1788837386.845248:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688767872 00000100:00100000:3.0:1788837386.845334:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:3.0:1788837386.845345:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:10541:x1875731688767872:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:3.0:1788837386.845405:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbb9 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837386.845788:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788837386.845833:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788837386.846114:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788837386.846185:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.846201:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb96 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.846223:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.846257:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb96 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.846272:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb96 expref: 42 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837386.846285:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875731708705280:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837386.847016:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788837386.850391:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875731708705280:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837386.850419:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837386.850969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.851036:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688768000 00000100:00100000:0.0:1788837386.851043:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688768000 00010000:00010000:0.0:1788837386.851076:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb96 expref: 43 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.851113:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:0.0:1788837386.851123:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+43:2360:x1875731688768000:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837386.851138:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837386.851145:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb96 expref: 43 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.851179:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb96 expref: 43 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.851202:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305aa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb96 expref: 43 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.851218:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb45631000) 00010000:00010000:0.0:1788837386.851223:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.851232:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.851240:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.851288:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837386.851326:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837386.851336:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.851372:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+42:2360:x1875731688768000:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 249us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.851381:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000001:00080000:3.0:1788837386.851465:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788837386.851647:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788837386.851742:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708705408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837386.851825:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837386.851861:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837386.852143:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708705408 00000100:00100000:0.0:1788837386.852156:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708705408 00000100:00100000:0.0:1788837386.852217:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837386.852226:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875731708705408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788837386.852336:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875731708705408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.852343:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837386.852531:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788837386.852537:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788837386.852554:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb50dcdc00, transno 4294967301 00000100:00100000:1.0:1788837386.852626:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708705408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788837386.853138:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788837386.853233:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708705536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788837386.853271:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837386.853301:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50f9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837386.853599:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708705536 00000100:00100000:2.0:1788837386.853605:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708705536 00000100:00100000:2.0:1788837386.853654:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837386.853663:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875731708705536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788837386.853820:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1875731708705536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (547us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788837386.853827:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788837386.854092:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837386.854182:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708705536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788837386.854233:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788837386.854277:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.854288:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.854296:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.854333:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837386.854337:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.854345:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.854361:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb45631000) 00010000:00010000:1.0:1788837386.854364:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788837386.854369:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837386.854375:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305afd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837386.854558:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788837386.854917:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788837386.854928:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340705623329ns, next at 341705621404ns, rc = 0 00000001:00080000:1.0:1788837386.854935:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788837386.854968:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb45631000) 00010000:00010000:1.0:1788837386.854971:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788837386.854977:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ae8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbb9 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837386.855120:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+45:10541:x1875731688767872:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 9776us (9985us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788837386.855128:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000020:00080000:1.0:1788837386.855132:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788837386.865013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.866871:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688768128 00000100:00100000:0.0:1788837386.866884:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688768128 00000100:00100000:0.0:1788837386.866957:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:0.0:1788837386.866968:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+45:10541:x1875731688768128:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837386.866993:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837386.867016:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305b04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbc0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.867073:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305b04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbc0 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.867087:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305b04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbc0 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.867106:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:0.0:1788837386.867125:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837386.867129:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917ac00, rc 0) 00000100:00100000:0.0:1788837386.867203:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+46:10541:x1875731688768128:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 237us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.867210:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:2.0:1788837386.874729:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837386.874831:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688768384 00000100:00100000:1.0:1788837386.874841:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688768384 00000100:00100000:1.0:1788837386.874899:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:1.0:1788837386.874909:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+46:10541:x1875731688768384:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837386.875292:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:10541:x1875731688768384:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 385us (571us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788837386.875300:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:2.0:1788837386.973584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837386.973942:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688768512 00000100:00100000:0.0:1788837386.973952:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688768512 00000100:00100000:0.0:1788837386.974181:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:0.0:1788837386.974193:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:10551:x1875731688768512:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1788837386.974264:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974282:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974294:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974364:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974373:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974380:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974456:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974465:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974484:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837386.974520:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974685:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974692:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974699:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974713:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837386.974717:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974725:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974738:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:0.0:1788837386.974741:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837386.974746:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974753:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974765:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974777:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974783:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974788:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917bc00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837386.974791:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974797:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974805:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb50df5300) 00010000:00010000:0.0:1788837386.974807:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837386.974810:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974816:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974829:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974835:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974841:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974846:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837386.974853:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974860:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974867:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:0.0:1788837386.974869:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837386.974872:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837386.974878:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be305b19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837386.974938:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:10551:x1875731688768512:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 747us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837386.980891:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 101 00010000:00010000:3.0:1788837386.981515:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837387.023665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837387.023874:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688768768 00000100:00100000:3.0:1788837387.023884:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688768768 00000100:00100000:3.0:1788837387.023990:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 102 00000100:00100000:3.0:1788837387.024013:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:10554:x1875731688768768:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837387.024040:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837387.024070:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbc7 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024140:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024168:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024180:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024204:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024213:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024219:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024356:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305b35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024365:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024389:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837387.024399:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788837387.024490:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024498:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024506:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024511:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837387.024515:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024522:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024535:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837387.024538:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837387.024543:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024547:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024559:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024565:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024577:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024582:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837387.024585:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024591:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024598:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb4556d000) 00010000:00010000:3.0:1788837387.024600:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837387.024603:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024608:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024658:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbc7 expref: 50 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024671:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbc7 expref: 49 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.024677:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837387.024680:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837387.024682:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030400, rc 0) 00000100:00100000:3.0:1788837387.025180:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+49:10554:x1875731688768768:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1168us (1520us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788837387.025573:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 102 00000100:00100000:2.0:1788837387.031109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837387.031200:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688768896 00000100:00100000:3.0:1788837387.031210:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688768896 00000100:00100000:3.0:1788837387.031269:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:3.0:1788837387.031280:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+49:10554:x1875731688768896:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1788837387.031375:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.031392:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.031403:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.031427:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.031434:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.031440:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.031446:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837387.031451:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.031459:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.031469:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837387.031482:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837387.031487:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.031494:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837387.031566:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+49:10554:x1875731688768896:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 287us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837387.031574:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:2.0:1788837387.034698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.034799:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688769152 00000100:00100000:1.0:1788837387.034809:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688769152 00000100:00100000:1.0:1788837387.034863:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:1.0:1788837387.034872:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+49:10554:x1875731688769152:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837387.035107:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:10554:x1875731688769152:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 236us (416us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788837387.035116:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:2.0:1788837387.146185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837387.146277:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688769408 00000100:00100000:0.0:1788837387.146288:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688769408 00000100:00100000:0.0:1788837387.146370:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 104 00000100:00100000:0.0:1788837387.146380:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:10564:x1875731688769408:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837387.146402:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837387.146406:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788837387.146432:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbab expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.146452:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:0.0:1788837387.146458:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837387.146470:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.146580:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.146593:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.146603:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837387.146677:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788837387.146797:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305b4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbce expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.146812:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbce expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.146820:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:0.0:1788837387.146823:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837387.146826:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917a400, rc 0) 00000100:00100000:0.0:1788837387.146938:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:10564:x1875731688769408:12345-192.168.203.43@tcp:101:bash.0 Request processed in 559us (761us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788837387.146946:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 104 00000100:00100000:0.0:1788837387.151840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837387.151950:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688769664 00000100:00100000:3.0:1788837387.151959:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688769664 00000100:00100000:3.0:1788837387.152074:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:3.0:1788837387.152085:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:10564:x1875731688769664:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:3.0:1788837387.152137:0:7291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788837387.152176:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305b51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbce expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.152207:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305b35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbc7 expref: 50 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.152218:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837387.152224:0:7291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837387.152494:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.152507:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.152516:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837387.152577:0:7291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788837387.152601:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003c272d0 reply state 0000000096b31899 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837387.152610:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837387.152843:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:10564:x1875731688769664:12345-192.168.203.43@tcp:36:bash.0 Request processed in 760us (1010us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788837387.152851:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 105 00000020:00080000:3.0:1788837387.152855:0:7291:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837387.155255:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.155270:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.155278:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.155283:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837387.155288:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.155296:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.155352:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:1.0:1788837387.155355:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837387.155360:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.155365:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305b5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837387.155843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.155952:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688769792 00000100:00100000:1.0:1788837387.155960:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688769792 00000100:00100000:1.0:1788837387.156009:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00100000:1.0:1788837387.156018:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:10564:x1875731688769792:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1788837387.156042:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837387.156056:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305b66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbd5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.156124:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.156134:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.156144:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837387.156184:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788837387.156187:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837387.156203:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.156237:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305b66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbd5 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.156251:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbd5 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.156257:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:1.0:1788837387.156260:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837387.156262:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576400, rc 0) 00000100:00100000:1.0:1788837387.156905:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:10564:x1875731688769792:12345-192.168.203.43@tcp:101:bash.0 Request processed in 884us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837387.156914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00100000:2.0:1788837387.161119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.161251:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688770048 00000100:00100000:1.0:1788837387.161262:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688770048 00000100:00100000:1.0:1788837387.161915:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1788837387.161927:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:10564:x1875731688770048:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:1.0:1788837387.162166:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+53:10564:x1875731688770048:12345-192.168.203.43@tcp:35:bash.0 Request processed in 241us (1055us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788837387.162172:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1788837387.245366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.245472:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688770176 00000100:00100000:1.0:1788837387.245482:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688770176 00000100:00100000:1.0:1788837387.245540:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 107 00000100:00100000:1.0:1788837387.245551:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+53:10570:x1875731688770176:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837387.245572:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837387.245594:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbdc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.245671:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305b7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.245685:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.245696:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837387.245727:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788837387.245731:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837387.245748:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.245770:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbdc expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.245787:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbdc expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.245811:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:1.0:1788837387.245814:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837387.245817:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577c00, rc 0) 00000100:00100000:1.0:1788837387.245874:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:10570:x1875731688770176:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 325us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837387.245882:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 107 00000100:00100000:0.0:1788837387.253687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837387.253978:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688770304 00000100:00100000:3.0:1788837387.253987:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688770304 00000100:00100000:3.0:1788837387.254061:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:3.0:1788837387.254072:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:10570:x1875731688770304:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837387.254090:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837387.254109:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305b82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbe3 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254186:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254200:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254211:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254225:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254250:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254257:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254391:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254400:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254408:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837387.254443:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788837387.254448:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837387.254465:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254477:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254485:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254491:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254498:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254514:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837387.254519:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254526:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254538:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837387.254541:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837387.254545:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254550:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305b89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254563:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254569:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254574:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254579:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837387.254581:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254587:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254605:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb4556d000) 00010000:00010000:3.0:1788837387.254607:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837387.254610:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254616:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305b90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254646:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305b82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 56 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254657:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 55 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.254664:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837387.254666:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837387.254668:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030600, rc 0) 00000100:00100000:3.0:1788837387.254835:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10570:x1875731688770304:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 765us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837387.254843:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:3.0:1788837387.258965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837387.258996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.259089:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688770560 00000100:00100000:1.0:1788837387.259099:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688770560 00000100:00100000:1.0:1788837387.259192:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:1.0:1788837387.259203:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10570:x1875731688770560:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837387.259222:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837387.259242:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305b9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbea expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.259383:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.259398:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbd5 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.259406:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 56 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.259414:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.259446:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 56 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.259460:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 56 pid: 7291 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837387.259472:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708705664:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837387.259575:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbd5 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.259597:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbd5 expref: 56 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837387.259607:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708705792:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837387.259632:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4999a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837387.259940:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688770688 00000100:00100000:2.0:1788837387.259946:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688770688 00010000:00010000:2.0:1788837387.259969:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 57 pid: 7291 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837387.260003:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1788837387.260011:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:2358:x1875731688770688:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837387.260029:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837387.260034:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 57 pid: 7291 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.260056:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 57 pid: 7291 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.260074:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:2.0:1788837387.260079:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.260086:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.260091:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837387.260132:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f598e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:2358:x1875731688770688:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 122us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837387.260140:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00010000:00010000:1.0:1788837387.263672:0:5844:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.43@tcp) returned -22 from blocking AST (req@00000000f5cde721 x1875731708705664) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 56 pid: 7291 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.263696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305b97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbe3 expref: 56 pid: 7291 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837387.263716:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708705664:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837387.263729:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708705792:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837387.263751:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:1.0:1788837387.263757:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.263765:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.263774:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837387.266179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.266496:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688770816 00000100:00100000:1.0:1788837387.266506:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688770816 00010000:00010000:1.0:1788837387.266558:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbd5 expref: 56 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837387.266590:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:1.0:1788837387.266600:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:2361:x1875731688770816:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837387.266615:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837387.266622:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbd5 expref: 56 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.266634:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbd5 expref: 56 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.266656:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbd5 expref: 56 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.266671:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:1.0:1788837387.266677:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.266686:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.266694:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.266725:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837387.266770:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:2361:x1875731688770816:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 172us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837387.266777:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00010000:00010000:3.0:1788837387.266966:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.266975:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837387.267002:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788837387.267163:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305b9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbea expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.267189:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbea expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.267196:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837387.267198:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788837387.267201:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577e00, rc 0) 00000100:00100000:3.0:1788837387.267240:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10570:x1875731688770560:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 8039us (8283us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788837387.267247:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:3.0:1788837387.271806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.271886:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688771072 00000100:00100000:2.0:1788837387.271895:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688771072 00000100:00100000:2.0:1788837387.271949:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1788837387.271958:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10570:x1875731688771072:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:2.0:1788837387.271972:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837387.271993:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be305b04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbc0 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.272010:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:2.0:1788837387.272015:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837387.272074:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:10570:x1875731688771072:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837387.272096:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1788837387.274769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837387.274849:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688771200 00000100:00100000:3.0:1788837387.274857:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688771200 00000100:00100000:3.0:1788837387.274908:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:3.0:1788837387.274918:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:10570:x1875731688771200:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:3.0:1788837387.275037:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.275059:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.275070:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837387.275296:0:11703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788837387.275413:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:10570:x1875731688771200:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 496us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837387.275421:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:3.0:1788837387.277851:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.277989:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688771328 00000100:00100000:2.0:1788837387.277999:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688771328 00000100:00100000:2.0:1788837387.278069:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:2.0:1788837387.278079:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:10570:x1875731688771328:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837387.278097:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837387.278115:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be305bba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbf1 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.278181:0:7291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.278192:0:7291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be305bba lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf1 expref: 55 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.278209:0:7291:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.278219:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be305bba lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf1 expref: 55 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.278233:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:2.0:1788837387.278236:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837387.278240:0:7291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be305bba lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf1 expref: 55 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.278247:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4c00, rc 0) 00000100:00100000:2.0:1788837387.278350:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10570:x1875731688771328:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 273us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837387.278358:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 111 00000040:00080000:2.0:1788837387.559824:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837387.559834:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837387.559886:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788837387.559892:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788837387.560007:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708705920:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837387.560592:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837387.564261:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708705920:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837387.579872:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.580721:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688771456 00000100:00100000:1.0:1788837387.580731:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688771456 00000100:00100000:1.0:1788837387.580793:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:1.0:1788837387.580804:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10571:x1875731688771456:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788837387.580832:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788837387.580935:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10571:x1875731688771456:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 133us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837387.580944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:3.0:1788837387.586083:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.586194:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688771584 00000100:00100000:2.0:1788837387.586203:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688771584 00000100:00100000:2.0:1788837387.586256:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:2.0:1788837387.586265:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10571:x1875731688771584:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788837387.586386:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586405:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586416:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586433:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586454:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586480:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586501:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586509:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586515:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837387.586550:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788837387.586554:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837387.586566:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586575:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586582:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586588:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586593:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837387.586596:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586603:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586620:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:2.0:1788837387.586623:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837387.586627:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586632:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305bc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586643:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586648:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586655:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586659:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837387.586662:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586667:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586673:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9acb454ce800) 00010000:00010000:2.0:1788837387.586676:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837387.586678:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586684:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305bc8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586705:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586710:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586716:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586721:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837387.586723:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586728:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586735:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:2.0:1788837387.586737:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837387.586740:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.586746:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305bcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837387.586804:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10571:x1875731688771584:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 540us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837387.586811:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:0.0:1788837387.599563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.599750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688771840 00000100:00100000:1.0:1788837387.599760:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688771840 00000100:00100000:1.0:1788837387.599818:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:1.0:1788837387.599828:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:10571:x1875731688771840:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837387.599847:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837387.599865:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305bd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbf8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.599950:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.599965:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.599975:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837387.599985:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788837387.600296:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.600354:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.600360:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.600366:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837387.600371:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.600378:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.600391:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:1.0:1788837387.600394:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788837387.600398:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.600404:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305bdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.600500:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305bd6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf8 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.600512:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:1.0:1788837387.600515:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837387.600519:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576400/0x843cbef8be305bd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf8 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.600530:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576400, rc 0) 00000100:00100000:1.0:1788837387.600605:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:10571:x1875731688771840:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 778us (1049us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788837387.600612:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:0.0:1788837387.605790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837387.606008:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688771968 00000100:00100000:3.0:1788837387.606017:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688771968 00000100:00100000:3.0:1788837387.606083:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:3.0:1788837387.606093:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:10571:x1875731688771968:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837387.606127:0:11703:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837387.606240:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:10571:x1875731688771968:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 147us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837387.606247:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:2.0:1788837387.624435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837387.624736:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688772224 00000100:00100000:3.0:1788837387.624746:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688772224 00000100:00100000:3.0:1788837387.624806:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:3.0:1788837387.624817:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:10571:x1875731688772224:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837387.624836:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837387.624840:0:7291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788837387.624865:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305b7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbdc expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.624887:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837387.624892:0:7291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837387.624905:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305beb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbbff expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837387.625668:0:7291:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788837387.625859:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305bf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.625875:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.625885:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.625935:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305beb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbff expref: 58 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.625952:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbff expref: 57 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.625961:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837387.625964:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837387.625967:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031a00, rc 0) 00000100:00100000:3.0:1788837387.626020:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:10571:x1875731688772224:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1205us (1594us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788837387.626027:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:0.0:1788837387.642002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837387.642155:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688772480 00000100:00100000:3.0:1788837387.642165:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688772480 00000100:00100000:3.0:1788837387.642232:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:3.0:1788837387.642243:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:10571:x1875731688772480:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837387.642300:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837387.642942:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305bf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbff expref: 57 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837387.642963:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837387.642974:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837387.643066:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643092:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643102:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643158:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643165:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643183:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643243:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643249:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643255:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643260:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837387.643264:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643272:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643280:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:2.0:1788837387.643288:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837387.643293:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643300:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643343:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643349:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643354:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643358:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837387.643360:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643365:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643685:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe61e2fc3 (ffff9acb454ce800) 00010000:00010000:2.0:1788837387.643689:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837387.643693:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.643700:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe61e2fc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837387.643786:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:10571:x1875731688772480:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1545us (1792us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837387.643799:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:0.0:1788837387.651920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.656850:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688772608 00000100:00100000:2.0:1788837387.656866:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688772608 00000100:00100000:2.0:1788837387.656938:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:2.0:1788837387.656950:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:10571:x1875731688772608:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837387.656970:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837387.656992:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc06 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.657042:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.657064:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.657075:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.657188:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc06 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.657207:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc06 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.657217:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:2.0:1788837387.657220:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837387.657223:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4400, rc 0) 00000100:00100000:2.0:1788837387.657290:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:10571:x1875731688772608:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 342us (5378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837387.657323:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:3.0:1788837387.660910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.662004:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688772864 00000100:00100000:2.0:1788837387.662017:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688772864 00000100:00100000:2.0:1788837387.662085:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:2.0:1788837387.662096:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:10571:x1875731688772864:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788837387.662185:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.662203:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.662214:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837387.662719:0:7291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788837387.662729:0:7291:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341513424780ns, next at 342513422072ns, rc = 0 00000004:00010000:2.0:1788837387.662810:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1f59fcf reply state 000000001d5982b0 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837387.662819:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837387.662919:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:10571:x1875731688772864:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 824us (2016us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788837387.662926:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00010000:00010000:1.0:1788837387.670180:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.670196:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.670204:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.670211:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837387.670215:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.670223:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.670238:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:1.0:1788837387.670241:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788837387.670245:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.670251:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837387.676071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.676913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688772992 00000100:00100000:2.0:1788837387.676923:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688772992 00000100:00100000:2.0:1788837387.676983:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:2.0:1788837387.676994:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+58:10571:x1875731688772992:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837387.677029:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837387.677070:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc0d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.677129:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc0d expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.677142:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc0d expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.677172:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:2.0:1788837387.677176:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837387.677180:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5800, rc 0) 00000100:00100000:2.0:1788837387.677244:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:10571:x1875731688772992:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 252us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837387.677251:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:3.0:1788837387.680130:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.680270:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688773120 00000100:00100000:1.0:1788837387.680279:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688773120 00000100:00100000:1.0:1788837387.680360:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:1.0:1788837387.680370:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2361:x1875731688773120:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788837387.680666:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2361:x1875731688773120:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 296us (543us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788837387.680674:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:3.0:1788837387.685097:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.685588:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688773376 00000100:00100000:2.0:1788837387.685600:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688773376 00000100:00100000:2.0:1788837387.685657:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:2.0:1788837387.685668:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:10571:x1875731688773376:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837387.685884:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:10571:x1875731688773376:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 218us (797us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788837387.685900:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:2.0:1788837387.700135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.700342:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688773632 00000100:00100000:1.0:1788837387.700351:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688773632 00000100:00100000:1.0:1788837387.700415:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:1.0:1788837387.700425:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:10571:x1875731688773632:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788837387.700802:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:10571:x1875731688773632:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 378us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837387.700810:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:3.0:1788837387.703026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.703415:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688773760 00000100:00100000:2.0:1788837387.703425:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688773760 00000100:00100000:2.0:1788837387.703544:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:2.0:1788837387.703554:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:10571:x1875731688773760:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837387.703578:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837387.703597:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc14 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.703660:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.703675:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.703685:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837387.703720:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837387.703737:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.703762:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc14 expref: 62 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.703781:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc14 expref: 61 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.703789:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:2.0:1788837387.703792:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788837387.703796:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4a00, rc 0) 00000100:00100000:2.0:1788837387.703946:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:10571:x1875731688773760:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 393us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837387.703953:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:3.0:1788837387.718252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.718463:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688773888 00000100:00100000:1.0:1788837387.718473:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688773888 00000100:00100000:1.0:1788837387.718527:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:1.0:1788837387.718538:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2358:x1875731688773888:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837387.718555:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837387.718575:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc1b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837387.718599:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7e0c, blocks: 0x1 00010000:00010000:1.0:1788837387.718616:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1788837387.718621:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837387.718628:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc1b expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.718646:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc1b expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.718671:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576400, rc 0) 00000100:00100000:1.0:1788837387.718730:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:2358:x1875731688773888:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 195us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837387.718737:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1788837387.723018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.723126:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688774144 00000100:00100000:2.0:1788837387.723135:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688774144 00000100:00100000:2.0:1788837387.723202:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:2.0:1788837387.723212:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:10571:x1875731688774144:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788837387.723468:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:10571:x1875731688774144:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 256us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837387.723476:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:3.0:1788837387.729991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.730187:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688774272 00000100:00100000:1.0:1788837387.730197:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688774272 00000100:00100000:1.0:1788837387.730253:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1788837387.730263:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:10571:x1875731688774272:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837387.730279:0:8306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837387.730295:0:8306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc22 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.730845:0:8306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc1b expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.730855:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837387.730859:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837387.730865:0:8306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 11 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.730897:0:8306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc1b expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.730910:0:8306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc1b expref: 11 pid: 6698 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837387.730934:0:8306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8306:1875731708706048:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837387.731046:0:8306:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4999a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837387.735451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837387.735643:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688774400 00000100:00100000:0.0:1788837387.735652:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688774400 00010000:00010000:0.0:1788837387.735689:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc1b expref: 12 pid: 6698 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837387.735732:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:0.0:1788837387.735741:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:2361:x1875731688774400:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837387.735756:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837387.735777:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc1b expref: 12 pid: 6698 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.735791:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc1b expref: 12 pid: 6698 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.735814:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837387.735818:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837387.735825:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 12 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.735834:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 12 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.735869:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 12 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837387.735897:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875731708706176:192.168.203.43@tcp:105: 00000100:00100000:0.0:1788837387.735977:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268780 going to sleep for 11 seconds 00010000:00010000:1.0:1788837387.737741:0:8306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc1b expref: 12 pid: 6698 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837387.737763:0:8306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8306:1875731708706048:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837387.737790:0:8306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 11 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.737803:0:8306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576c00, rc 0) 00000100:00100000:1.0:1788837387.737851:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:10571:x1875731688774272:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 7590us (7869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837387.737859:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:0.0:1788837387.748076:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875731708706176:192.168.203.43@tcp:105: 00010000:00010000:0.0:1788837387.748106:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837387.748179:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:2361:x1875731688774400:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 12438us (12744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837387.748189:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1788837387.754201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.754348:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688774528 00000100:00100000:1.0:1788837387.754358:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688774528 00002000:00100000:1.0:1788837387.754403:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9acb44fa2300 x1875731688774528/t0(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:43/0 lens 504/0 e 0 to 0 dl 1788837398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837387.754412:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb44fa2300 with x1875731688774528 ext(0->12) 00002000:00010000:1.0:1788837387.754417:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb44fa2300 00000100:00100000:1.0:1788837387.754447:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:1.0:1788837387.754457:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:2360:x1875731688774528:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788837387.754874:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:2360:x1875731688774528:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 418us (680us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788837387.754887:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00002000:00100000:1.0:1788837387.754894:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9acb44fa2300 x1875731688774528/t4294967308(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:43/0 lens 504/448 e 0 to 0 dl 1788837398 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837387.754902:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb44fa2300 with x1875731688774528 ext(0->12) 00002000:00010000:1.0:1788837387.754905:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb44fa2300 00000100:00100000:3.0:1788837387.758532:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.759060:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688774656 00000100:00100000:1.0:1788837387.759070:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688774656 00000100:00100000:1.0:1788837387.759132:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:1.0:1788837387.759154:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:10571:x1875731688774656:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788837387.849814:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000001:00080000:3.0:1788837387.849850:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:3.0:1788837387.849863:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788837387.849879:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9acb50f9c900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788837387.849885:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb6a6e4f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9acb50f9c480 00000020:00080000:3.0:1788837387.849888:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb6a6e4600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9acb74c35400 00000020:00080000:3.0:1788837387.849908:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:3.0:1788837387.849921:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788837387.849928:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788837387.849946:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9acb512d7180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788837387.849950:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb797c6b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9acb62d4a0c0 00000020:00080000:3.0:1788837387.849953:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb797c6400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9acb75516000 00000100:00100000:0.0:1788837387.850327:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708706304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788837387.850488:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837387.850672:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708706432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788837387.850702:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837387.850821:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708706304 00000100:00100000:1.0:1788837387.850828:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708706304 00000100:00100000:1.0:1788837387.850877:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708706432 00000100:00100000:1.0:1788837387.850880:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708706432 00000100:00100000:1.0:1788837387.850900:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837387.850908:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1875731708706304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788837387.850931:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788837387.850954:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.850975:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb81 expref: 11 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.850984:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788837387.850989:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837387.850993:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.851041:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb81 expref: 11 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.851065:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb81 expref: 11 pid: 6701 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837387.851078:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708706688:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837387.851136:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fbad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837387.851156:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837387.851165:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708706560:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788837387.851192:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788837387.851212:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837387.851222:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708706560 00000100:00100000:1.0:1788837387.851225:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708706560 00000100:00100000:1.0:1788837387.851245:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837387.851251:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875731708706432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788837387.851418:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788837387.851422:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788837388 00002000:00010000:1.0:1788837387.851425:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788837387.851427:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788837388 -> 1788837388 00002000:00010000:1.0:1788837387.851429:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788837387.851468:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1875731708706432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (764us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788837387.851476:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837387.851492:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788837387.851505:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb436c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1875731708706560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788837387.851518:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788837387.851537:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f7e0b, atime: 0x6a9f7e0b, ctime: 0x6a9f7e0b, blocks: 0x1 00010000:00010000:1.0:1788837387.851542:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.851551:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1788837387.851554:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837387.851558:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.851572:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.851580:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.851587:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.851603:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788837387.852033:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb436c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1875731708706560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 529us (839us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788837387.852040:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1788837387.852179:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb79630700/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788837387.852185:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708706560:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788837387.852207:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb44fa1f80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788837387.852219:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708706432:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788837387.852233:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837387.852238:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.852247:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577200 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837387.852251:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.852261:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.852276:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.852284:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ca3caab/0x843cbef8be305c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.852330:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837387.852332:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837387.852334:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788837387.857444:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788837387.857642:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788837387.860589:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:10571:x1875731688774656:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 101436us (102054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837387.860601:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000004:00080000:1.0:1788837387.862759:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788837387.872729:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837387.872770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837387.872848:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688774784 00000100:00100000:0.0:1788837387.872857:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688774784 00010000:00010000:0.0:1788837387.872900:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb81 expref: 12 pid: 6701 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837387.872940:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:0.0:1788837387.872949:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:2360:x1875731688774784:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837387.872965:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837387.872971:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb81 expref: 12 pid: 6701 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.872985:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb81 expref: 12 pid: 6701 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.873058:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837387.873064:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837387.875160:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.875180:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837387.875219:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837387.875290:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:2360:x1875731688774784:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 2337us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837387.875300:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00010000:00010000:2.0:1788837387.878566:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000303e1be5/0x843cbef8be305a08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb81 expref: 11 pid: 6701 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837387.878597:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708706688:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837387.878626:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.878638:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.878644:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.878668:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.878675:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.878704:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837387.879325:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837387.879333:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.879355:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837387.879359:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.879369:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.879399:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.879406:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2de9ac4/0x843cbef8be305c46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837387.879424:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837387.879426:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837387.879428:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837387.882931:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3313:x1875731708706304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32015us (32434us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788837387.882943:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788837387.883100:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688774912 00000100:00100000:2.0:1788837387.883108:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688774912 00000100:00100000:3.0:1788837387.883272:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1788837387.889515:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:2359:x1875731688774912:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788837387.897119:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb44fa1500/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788837387.897134:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708706304:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788837387.990250:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788837387.990271:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788837387.990277:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1788837387.990287:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:1.0:1788837387.991706:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688774912:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 108416us (118926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837387.991719:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1788837387.998120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837387.998352:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688775168 00000100:00100000:2.0:1788837387.998361:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688775168 00000100:00100000:2.0:1788837387.998419:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:2.0:1788837387.998447:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:10571:x1875731688775168:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788837387.998500:0:7291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837387.998527:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc14 expref: 15 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.998546:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:2.0:1788837387.998551:0:7291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837387.998578:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.998590:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837387.998610:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837387.998808:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e34ed1c4 reply state 00000000c317ae5f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837387.998817:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837387.998901:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:10571:x1875731688775168:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 463us (789us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788837387.998908:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00010000:00010000:0.0:1788837388.007279:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837388.008275:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.008290:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.008467:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.008474:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837388.008478:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.008486:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.008503:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:1.0:1788837388.008505:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837388.008510:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.008516:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305c54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837388.011490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837388.012177:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688775296 00000100:00100000:1.0:1788837388.012190:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688775296 00000100:00080000:3.0:1788837388.012336:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837388.012418:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1788837388.012430:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688775296:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788837388.012645:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788837388.012648:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788837388 -> 1788837388 00002000:00010000:1.0:1788837388.012650:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788837387 00002000:00010000:1.0:1788837388.012652:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788837388 -> 1788837388 00002000:00010000:1.0:1788837388.012653:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788837388.012708:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688775296:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 281us (1228us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788837388.012725:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:0.0:1788837388.015402:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837388.015586:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688775552 00000100:00100000:2.0:1788837388.015595:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688775552 00000100:00100000:2.0:1788837388.015660:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:2.0:1788837388.015669:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:10571:x1875731688775552:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788837388.015728:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.015744:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc06 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.015753:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.015897:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc06 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.015911:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc06 expref: 15 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837388.015941:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875731708706816:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837388.016407:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d7900 going to sleep for 11 seconds 00000100:00080000:3.0:1788837388.016789:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837388.029635:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875731708706816:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837388.029674:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837388.035045:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837388.041949:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688775680 00000100:00100000:2.0:1788837388.041966:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688775680 00010000:00010000:2.0:1788837388.042025:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc06 expref: 16 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837388.042063:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1788837388.042073:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:2360:x1875731688775680:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837388.042089:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837388.042096:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc06 expref: 16 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.042110:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc06 expref: 16 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.042152:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc06 expref: 16 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.042170:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:2.0:1788837388.042179:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.042202:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.042210:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.042359:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837388.042421:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:2360:x1875731688775680:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 349us (7386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837388.042430:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00010000:00010000:3.0:1788837388.048291:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.048336:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.048402:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.048411:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.048419:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.048426:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837388.048431:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.048439:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.048456:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:3.0:1788837388.048460:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788837388.048465:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.048471:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305c5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837388.048580:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:10571:x1875731688775552:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 32907us (33182us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788837388.048590:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:0.0:1788837388.055255:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837388.057328:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688775808 00000100:00100000:1.0:1788837388.057344:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688775808 00000100:00100000:0.0:1788837388.057531:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1788837388.057543:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688775808:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788837388.057602:0:8306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.057635:0:8306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 7 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.057643:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837388.057648:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837388.057653:0:8306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.057688:0:8306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 7 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.057702:0:8306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 7 pid: 8306 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837388.057717:0:8306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8306:1875731708706944:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837388.058292:0:8306:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837388.064261:0:8306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8306:1875731708706944:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837388.064293:0:8306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837388.068108:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837388.068886:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688775936 00000100:00100000:2.0:1788837388.068898:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688775936 00010000:00010000:2.0:1788837388.068937:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 8 pid: 8306 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837388.068981:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:2.0:1788837388.068991:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2361:x1875731688775936:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837388.069006:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837388.069057:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 8 pid: 8306 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.069072:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 8 pid: 8306 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.069095:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf847d99/0x843cbef8be305c3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc22 expref: 8 pid: 8306 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.069129:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837388.069135:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837388.069149:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.069160:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.069192:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837388.069248:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688775936:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 258us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837388.069255:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00010000:00010000:0.0:1788837388.069561:0:8306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.069583:0:8306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.069608:0:8306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.069617:0:8306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.069625:0:8306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.069632:0:8306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a600 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837388.069636:0:8306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.069645:0:8306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.069658:0:8306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837388.069666:0:8306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be305c62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837388.069736:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688775808:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 12195us (14490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837388.069744:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1788837388.072285:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837388.072448:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688776192 00000100:00100000:2.0:1788837388.072458:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688776192 00000100:00100000:2.0:1788837388.072504:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:2.0:1788837388.072514:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:10571:x1875731688776192:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837388.072625:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.072643:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.072653:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.072879:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.072892:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc0d expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.072900:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.072933:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc0d expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.072947:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc0d expref: 15 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837388.072961:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708707072:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837388.073535:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837388.088279:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708707072:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837388.088445:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837388.095736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837388.095793:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837388.095823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837388.095858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837388.095878:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837388.095905:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837388.095933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688776576 00000100:00100000:0.0:1788837388.095943:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688776576 00000100:00100000:0.0:1788837388.095988:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688776960 00000100:00100000:0.0:1788837388.095991:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688776960 00000100:00100000:0.0:1788837388.096045:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:0.0:1788837388.096055:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:2358:x1875731688776576:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837388.096161:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:2358:x1875731688776576:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 107us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837388.096169:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:0.0:1788837388.096189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:0.0:1788837388.096196:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688776960:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837388.096221:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2358:x1875731688776960:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837388.096227:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00080000:0.0:1788837388.096258:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837388.096269:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688776832 00000100:00100000:0.0:1788837388.096273:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688776832 00000100:00100000:0.0:1788837388.096300:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688776704 00000100:00100000:0.0:1788837388.096343:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688776704 00000100:00100000:0.0:1788837388.096365:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:0.0:1788837388.096371:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2358:x1875731688776832:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837388.096398:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2358:x1875731688776832:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837388.096405:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:0.0:1788837388.096416:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:0.0:1788837388.096422:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688776704:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837388.096444:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2358:x1875731688776704:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837388.096450:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00080000:0.0:1788837388.096463:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837388.096820:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688776448 00000100:00100000:2.0:1788837388.096825:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688776448 00000100:00100000:2.0:1788837388.096862:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 283 00000100:00100000:2.0:1788837388.096869:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688776448:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837388.096911:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688776448:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837388.096918:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 283 00000100:00100000:1.0:1788837388.097210:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688776320 00000100:00100000:1.0:1788837388.097215:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688776320 00010000:00010000:1.0:1788837388.097239:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc0d expref: 16 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837388.097270:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:1.0:1788837388.097277:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:2360:x1875731688776320:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837388.097288:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837388.097294:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc0d expref: 16 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.097344:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc0d expref: 16 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.097366:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5800/0x843cbef8be305c23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc0d expref: 16 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.097382:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:1.0:1788837388.097388:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.097397:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.097405:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.097433:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837388.097455:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:2360:x1875731688776320:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 178us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837388.097461:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00010000:00010000:3.0:1788837388.097568:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.097577:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837388.097745:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788837388.097899:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788837388.097944:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788837388.098017:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875731708707200:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788837388.098062:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837388.098098:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837388.098678:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708707200 00000100:00100000:1.0:1788837388.098685:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708707200 00000100:00100000:1.0:1788837388.098715:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837388.098723:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875731708707200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788837388.098806:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875731708707200:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837388.098813:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837388.098936:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788837388.098942:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1788837388.098961:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb44fa1f80, transno 4294967309 00000004:00080000:3.0:1788837388.098978:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb44fa1500, transno 4294967310 00000100:00100000:3.0:1788837388.098984:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875731708707200:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788837388.100725:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788837388.101134:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875731708707328:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788837388.101201:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837388.101286:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837388.105269:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708707328 00000100:00100000:1.0:1788837388.105286:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708707328 00000100:00100000:1.0:1788837388.105589:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837388.105600:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875731708707328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788837388.106214:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875731708707328:12345-0@lo:1000:mdt00_002.0 Request processed in 615us (5010us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788837388.106222:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837388.109508:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875731708707328:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788837388.109686:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.109720:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.109728:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.109734:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837388.109739:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.109747:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.109763:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce700) 00010000:00010000:3.0:1788837388.109766:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837388.109771:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.109777:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305c70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.110121:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.110128:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.110132:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.110136:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837388.110154:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.110160:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.110168:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837388.110170:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837388.110177:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be305bba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf1 expref: 18 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.110188:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be305bba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf1 expref: 18 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.110196:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be305bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf1 expref: 18 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.110231:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be305bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf1 expref: 18 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837388.110245:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708707456:192.168.203.43@tcp:105: 00000100:00100000:3.0:1788837388.110515:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837388.113542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837388.113555:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708707456:192.168.203.43@tcp:105: 00010000:00010000:3.0:1788837388.113578:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113589:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305bb3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837388.113618:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688777088 00000100:00100000:2.0:1788837388.113630:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688777088 00010000:00010000:3.0:1788837388.113634:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113646:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113655:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113664:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113670:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837388.113670:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00010000:00010000:3.0:1788837388.113676:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837388.113679:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:10570:x1875731688777088:12345-192.168.203.43@tcp:49:lfs.0 00010000:00010000:3.0:1788837388.113682:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837388.113686:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113692:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113701:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837388.113703:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837388.113707:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113711:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113726:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113732:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113737:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113742:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837388.113744:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113749:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113755:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837388.113757:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837388.113759:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.113764:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837388.113919:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:10570:x1875731688777088:12345-192.168.203.43@tcp:49:lfs.0 Request processed in 240us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837388.113926:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:3.0:1788837388.113929:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:10571:x1875731688776192:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 41418us (41653us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788837388.113936:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 127 00000020:00080000:3.0:1788837388.113939:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788837388.114031:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837388.114036:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837388.115027:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788837388.115037:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837388.118393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837388.118460:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688777344 00000100:00100000:2.0:1788837388.118470:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688777344 00000100:00100000:2.0:1788837388.118535:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:2.0:1788837388.118545:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:10571:x1875731688777344:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788837388.121077:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837388.121338:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688777600 00000100:00100000:1.0:1788837388.121346:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688777600 00000100:00100000:1.0:1788837388.121390:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:1.0:1788837388.121399:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:10570:x1875731688777600:12345-192.168.203.43@tcp:58:lfs.0 00000040:00080000:1.0:1788837388.121679:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788837388.121754:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:10570:x1875731688777600:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 356us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837388.121770:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 128 00000004:00080000:2.0:1788837388.122215:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788837388.122328:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788837388.122382:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.122396:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.122406:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.122413:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.122418:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.122430:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.122441:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788837388.122507:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:10571:x1875731688777344:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 3963us (4121us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788837388.122516:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000020:00080000:2.0:1788837388.122519:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837388.127461:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837388.127477:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.127489:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa4400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837388.127494:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.127504:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.127522:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9acb454ce800) 00010000:00010000:1.0:1788837388.127525:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788837388.127530:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.127536:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305c7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837388.127559:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837388.127561:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837388.127563:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837388.133590:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708707584:0@lo:400:kworker.0 00000100:00100000:1.0:1788837388.133662:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837388.133791:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708707968:0@lo:400:kworker.0 00000100:00100000:3.0:1788837388.133847:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837388.133905:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708707840:0@lo:400:kworker.0 00000100:00100000:3.0:1788837388.133931:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837388.133949:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837388.133955:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708707712:0@lo:400:kworker.0 00000100:00100000:3.0:1788837388.133977:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837388.134004:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708707968 00000100:00100000:3.0:1788837388.134011:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708707968 00000100:00100000:3.0:1788837388.134058:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708707840 00000100:00100000:3.0:1788837388.134061:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708707840 00000100:00100000:3.0:1788837388.134079:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708707712 00000100:00100000:3.0:1788837388.134081:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708707712 00000100:00100000:3.0:1788837388.134110:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788837388.134118:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708707968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837388.134175:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708707968:12345-0@lo:400:kworker.0 Request processed in 57us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837388.134182:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788837388.134199:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788837388.134217:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708707840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837388.134246:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708707840:12345-0@lo:400:kworker.0 Request processed in 42us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837388.134251:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788837388.134261:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788837388.134266:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708707712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837388.134286:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708707712:12345-0@lo:400:kworker.0 Request processed in 20us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837388.134290:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788837388.134348:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708707712:0@lo:400:kworker.0 00000100:00100000:3.0:1788837388.134367:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708707840:0@lo:400:kworker.0 00000100:00100000:3.0:1788837388.134395:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708707968:0@lo:400:kworker.0 00000100:00100000:0.0:1788837388.134476:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708707584 00000100:00100000:0.0:1788837388.134480:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708707584 00000100:00100000:0.0:1788837388.134508:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788837388.134514:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708707584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837388.147908:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708708096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837388.147983:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788837388.151376:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837388.157756:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708707584:12345-0@lo:400:kworker.0 Request processed in 23232us (24083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837388.157771:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788837388.157959:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708707584:0@lo:400:kworker.0 00000100:00100000:1.0:1788837388.158001:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708708096 00000100:00100000:1.0:1788837388.158022:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708708096 00000100:00100000:1.0:1788837388.158358:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837388.158367:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875731708708096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837388.158403:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837388.158470:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875731708708096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (10486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837388.158477:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837388.158514:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708708096:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788837388.159786:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837388.162837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837388.163153:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688777728 00000100:00100000:3.0:1788837388.163163:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688777728 00000100:00100000:3.0:1788837388.163223:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:3.0:1788837388.163244:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:10573:x1875731688777728:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837388.163267:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837388.163287:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc29 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163379:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163395:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163410:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163443:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163451:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163458:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163721:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163734:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbea expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163742:0:11703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163774:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbea expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.163788:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbea expref: 21 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837388.163801:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875731708708224:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837388.163887:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837388.176596:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875731708708224:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837388.176638:0:11703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837388.176777:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837388.176846:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688777984 00000100:00100000:1.0:1788837388.176853:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688777984 00000100:00100000:1.0:1788837388.176904:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:1.0:1788837388.176914:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:9975:x1875731688777984:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788837388.177139:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:9975:x1875731688777984:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 225us (361us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788837388.177156:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1788837388.182753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837388.182900:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688778112 00000100:00100000:2.0:1788837388.182911:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688778112 00010000:00010000:2.0:1788837388.182952:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbea expref: 23 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837388.182996:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:2.0:1788837388.183006:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:2360:x1875731688778112:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837388.183020:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837388.183027:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbea expref: 23 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.183038:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbea expref: 23 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.183071:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be305ba5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbea expref: 23 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.183105:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:2.0:1788837388.183111:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.183119:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.183126:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837388.183161:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837388.183222:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:2360:x1875731688778112:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 217us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837388.183684:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00010000:00010000:3.0:1788837388.183910:0:11703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.183919:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837388.183961:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788837388.183965:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837388.183984:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.183996:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184017:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184024:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184030:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184037:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837388.184041:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184061:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184072:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837388.184075:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837388.184079:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184085:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305c8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184594:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184604:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184609:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184621:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837388.184624:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184630:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184639:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9acb4556d000) 00010000:00010000:3.0:1788837388.184641:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837388.184644:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184651:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184777:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305c85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc29 expref: 22 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184797:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc29 expref: 21 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837388.184805:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837388.184807:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837388.184810:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031200, rc 0) 00000100:00100000:3.0:1788837388.184860:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:10573:x1875731688777728:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 21619us (22032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837388.184868:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00010000:00010000:0.0:1788837389.033383:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788837389.096754:0:12111:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837389.096764:0:12111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837389.096829:0:12111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788837389.096836:0:12111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788837389.161789:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837389.161806:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837389.162337:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788837389.162343:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837389.162452:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708708352:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837389.162539:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b2c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788837389.171070:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837389.171102:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688778240 00000100:00100000:3.0:1788837389.171111:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688778240 00000100:00100000:3.0:1788837389.171173:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:3.0:1788837389.171183:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:10585:x1875731688778240:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837389.171215:0:7291:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837389.171371:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:10585:x1875731688778240:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 190us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837389.171379:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:3.0:1788837389.171500:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708708352:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837389.180701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837389.180762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688778496 00000100:00100000:1.0:1788837389.180771:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688778496 00000100:00100000:1.0:1788837389.180825:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:1.0:1788837389.180835:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:10585:x1875731688778496:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837389.180854:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837389.180873:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305ca1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc30 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837389.180981:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837389.180996:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837389.181008:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837389.181019:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788837389.181162:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be305ca1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc30 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837389.181179:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc30 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837389.181187:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:1.0:1788837389.181190:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837389.181194:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577000, rc 0) 00000100:00100000:1.0:1788837389.181255:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:10585:x1875731688778496:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 422us (563us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788837389.181262:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:3.0:1788837389.188246:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837389.188288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837389.188343:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688778880 00000100:00100000:3.0:1788837389.188353:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688778880 00000100:00100000:3.0:1788837389.188402:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:3.0:1788837389.188412:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:10585:x1875731688778880:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837389.188491:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837389.188509:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837389.188532:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837389.188737:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837389.188745:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837389.188752:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837389.188759:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837389.188763:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837389.188770:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837389.188782:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837389.188785:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837389.188789:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837389.188794:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837389.188923:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:10585:x1875731688778880:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 511us (632us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788837389.188932:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 132 00000040:00080000:3.0:1788837389.189042:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837389.189047:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837389.189608:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788837389.189618:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837389.189726:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688778624 00000100:00100000:1.0:1788837389.189732:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688778624 00000100:00100000:1.0:1788837389.189786:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:1.0:1788837389.189795:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:2359:x1875731688778624:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837389.189808:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837389.189832:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc30 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837389.189846:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:1.0:1788837389.189850:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837389.189879:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:2359:x1875731688778624:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 86us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837389.189885:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1788837389.200182:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837389.200245:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688779136 00000100:00100000:3.0:1788837389.200254:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688779136 00000100:00100000:3.0:1788837389.200327:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:3.0:1788837389.200339:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:10585:x1875731688779136:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788837389.200546:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:10585:x1875731688779136:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 209us (371us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788837389.200554:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00010000:00010000:1.0:1788837390.053595:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837390.181467:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837390.181488:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708708480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837390.181553:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837390.181624:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708708480 00000100:00100000:2.0:1788837390.181632:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708708480 00000100:00100000:2.0:1788837390.181694:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788837390.181704:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875731708708480:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837390.181723:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788837390.181737:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837390.181787:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875731708708480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837390.181794:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788837390.181853:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708708480:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788837390.883144:0:12163:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837390.883154:0:12163:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837390.883357:0:12163:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788837390.883364:0:12163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788837391.078660:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837391.129677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837391.129917:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688779392 00000100:00100000:3.0:1788837391.129927:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688779392 00000100:00100000:3.0:1788837391.130004:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:3.0:1788837391.130016:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:10605:x1875731688779392:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837391.130039:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837391.130059:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc37 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.130160:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305cc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.130175:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.130186:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837391.130209:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788837391.130532:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305cbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc37 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.130552:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc37 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.130562:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837391.130565:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788837391.130568:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030400, rc 0) 00000100:00100000:3.0:1788837391.130618:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:10605:x1875731688779392:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 605us (950us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788837391.130626:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00080000:2.0:1788837391.130724:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837391.141567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837391.141738:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688779520 00000100:00100000:3.0:1788837391.141748:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688779520 00000100:00100000:3.0:1788837391.141805:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:3.0:1788837391.141815:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:10605:x1875731688779520:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1788837391.141884:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.141901:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.141912:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.141936:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.141956:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.141963:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.141970:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837391.141974:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.141982:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.142150:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837391.142154:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837391.142160:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837391.142167:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837391.142237:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:10605:x1875731688779520:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 423us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837391.142245:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:0.0:1788837391.286206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837391.286332:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688779648 00000100:00100000:2.0:1788837391.286342:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688779648 00000100:00100000:2.0:1788837391.286409:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:2.0:1788837391.286420:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688779648:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:2.0:1788837391.286434:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837391.286453:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000308d0061/0x843cbef8be305cd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc3e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837391.286477:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f7e0c, atime: 0x6a9f7e0b, ctime: 0x6a9f7e0c, blocks: 0xb 00010000:00010000:2.0:1788837391.286495:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788837391.286499:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837391.286508:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000308d0061/0x843cbef8be305cd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc3e expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837391.286527:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000308d0061/0x843cbef8be305cd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc3e expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837391.286539:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa5800, rc 0) 00000100:00100000:2.0:1788837391.286589:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688779648:12345-192.168.203.43@tcp:101:cat.0 Request processed in 172us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837391.286596:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00080000:0.0:1788837391.286784:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788837391.291847:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788837391.291862:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788837391.305894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837391.306011:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688779776 00000100:00100000:1.0:1788837391.306021:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688779776 00002000:00100000:1.0:1788837391.306078:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9acb754e5f80 x1875731688779776/t0(0) o3->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:47/0 lens 488/0 e 0 to 0 dl 1788837402 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837391.306089:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb754e5f80 with x1875731688779776 ext(0->4095) 00002000:00010000:1.0:1788837391.306095:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb754e5f80 00000100:00100000:1.0:1788837391.306142:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:1.0:1788837391.306153:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2359:x1875731688779776:12345-192.168.203.43@tcp:3:cat.0 00000100:00100000:1.0:1788837391.306407:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2359:x1875731688779776:12345-192.168.203.43@tcp:3:cat.0 Request processed in 255us (520us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788837391.306415:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00002000:00100000:1.0:1788837391.306422:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9acb754e5f80 x1875731688779776/t0(0) o3->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:47/0 lens 488/4536 e 0 to 0 dl 1788837402 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837391.306430:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb754e5f80 with x1875731688779776 ext(0->4095) 00002000:00010000:1.0:1788837391.306434:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb754e5f80 00010000:00010000:1.0:1788837392.101807:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837393.126469:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837393.222051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837393.224286:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837393.224403:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837393.224466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837393.224531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837393.229670:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688780288 00000100:00100000:1.0:1788837393.229685:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688780288 00000100:00100000:1.0:1788837393.229756:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688780160 00000100:00100000:1.0:1788837393.229759:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688780160 00000100:00100000:1.0:1788837393.229802:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1788837393.229813:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688780288:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837393.229890:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688780288:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 78us (5619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837393.229897:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1788837393.229914:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:1.0:1788837393.229920:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2359:x1875731688780160:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837393.229944:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2359:x1875731688780160:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (5478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837393.229950:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00080000:1.0:1788837393.230100:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837393.230104:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837393.230129:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688779904 00000100:00100000:1.0:1788837393.230133:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688779904 00000100:00100000:1.0:1788837393.230161:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 285 00000100:00100000:1.0:1788837393.230168:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2359:x1875731688779904:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837393.230200:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2359:x1875731688779904:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 32us (5796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837393.230206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 285 00000100:00100000:3.0:1788837393.240849:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688780032 00000100:00100000:3.0:1788837393.240861:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688780032 00000100:00100000:3.0:1788837393.240935:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688780416 00000100:00100000:3.0:1788837393.240938:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688780416 00000100:00100000:3.0:1788837393.240968:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:3.0:1788837393.240977:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:2359:x1875731688780032:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837393.241066:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:2359:x1875731688780032:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 89us (19023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837393.241074:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:3.0:1788837393.241090:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:3.0:1788837393.241097:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2359:x1875731688780416:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837393.241133:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2359:x1875731688780416:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 37us (16602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837393.241140:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00080000:1.0:1788837393.241388:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837393.265028:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708708608:0@lo:400:kworker.0 00000100:00100000:3.0:1788837393.265100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837393.267584:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708708864:0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.267676:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837393.267746:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708709376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837393.267777:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837393.267811:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788837393.267818:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708708736:0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.267841:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837393.267858:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708709248:0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.267878:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837393.267912:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708708992:0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.267937:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837393.267983:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708708864 00000100:00100000:2.0:1788837393.267990:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708708864 00000100:00100000:2.0:1788837393.268042:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708708736 00000100:00100000:2.0:1788837393.268045:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708708736 00000100:00100000:2.0:1788837393.268067:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788837393.268075:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708708864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.268139:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708708864:12345-0@lo:400:kworker.0 Request processed in 64us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837393.268147:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788837393.268164:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788837393.268171:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708708736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.268200:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708708736:12345-0@lo:400:kworker.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837393.268206:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788837393.268224:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708709376 00000100:00100000:2.0:1788837393.268228:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708709376 00000100:00100000:2.0:1788837393.268270:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837393.268277:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708709376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837393.268331:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837393.268364:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708709376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837393.268370:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837393.268392:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708709248 00000100:00100000:2.0:1788837393.268396:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708709248 00000100:00100000:2.0:1788837393.268418:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708708992 00000100:00100000:2.0:1788837393.268421:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708708992 00000100:00100000:2.0:1788837393.268443:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788837393.268449:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708709248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.268480:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708709248:12345-0@lo:400:kworker.0 Request processed in 31us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837393.268486:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788837393.268498:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788837393.268516:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708708992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.268548:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708708992:12345-0@lo:400:kworker.0 Request processed in 34us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837393.268554:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788837393.268570:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837393.268574:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837393.268576:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837393.268618:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708708992:0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.268645:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708708736:0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.268653:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788837393.268658:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788837393.268674:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb79630700, transno 4294967304 00000100:00100000:2.0:1788837393.268691:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708709248:0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.268703:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708708864:0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.268716:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708709376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837393.271490:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708709120:0@lo:400:kworker.0 00000100:00100000:3.0:1788837393.271555:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837393.271570:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708708608 00000100:00100000:2.0:1788837393.271608:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708708608 00000100:00100000:2.0:1788837393.271816:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788837393.271839:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708708608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837393.271857:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708709120 00000100:00100000:3.0:1788837393.271864:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708709120 00000100:00100000:2.0:1788837393.271910:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708708608:12345-0@lo:400:kworker.0 Request processed in 85us (6809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837393.271914:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788837393.271923:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708709120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837393.271961:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708709120:12345-0@lo:400:kworker.0 Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837393.271967:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788837393.271987:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837393.272014:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708708608:0@lo:400:kworker.0 00000100:00100000:3.0:1788837393.272028:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708709120:0@lo:400:kworker.0 00000100:00100000:2.0:1788837393.273350:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000001:00080000:1.0:1788837393.314637:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:1.0:1788837393.314659:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1788837393.314675:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788837393.314699:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9acb46b2c780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788837393.314703:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb46831100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9acb46b2c3c0 00000020:00080000:1.0:1788837393.314707:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb46831500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9acb74c34000 00000020:00080000:3.0:1788837393.314746:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788837393.314886:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788837393.330644:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788837393.330657:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:2.0:1788837394.153847:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837395.174854:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837395.303761:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837395.303784:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708709504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837395.303864:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837395.304264:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708709504 00000100:00100000:2.0:1788837395.304272:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708709504 00000100:00100000:2.0:1788837395.304368:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788837395.304379:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708709504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837395.304410:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837395.304463:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708709504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837395.304470:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788837395.305149:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837395.305291:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788837395.305298:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788837395.305350:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708709504:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788837395.366209:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837395.366230:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837395.366880:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788837395.366889:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788837396.202942:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837396.705649:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837396.705751:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688780544 00000100:00100000:2.0:1788837396.705761:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688780544 00000100:00080000:3.0:1788837396.705844:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837396.705857:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:2.0:1788837396.705869:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10249:x1875731688780544:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788837396.705974:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10249:x1875731688780544:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 107us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837396.705990:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:1.0:1788837396.708732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837396.708866:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688780800 00000100:00100000:2.0:1788837396.708875:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688780800 00000100:00100000:2.0:1788837396.708985:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1788837396.708997:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:10249:x1875731688780800:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837396.709387:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:10249:x1875731688780800:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 392us (662us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788837396.709395:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:1.0:1788837397.055657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837397.055752:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688780928 00000100:00100000:2.0:1788837397.055762:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688780928 00000100:00100000:2.0:1788837397.055872:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00100000:2.0:1788837397.055884:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:11059:x1875731688780928:12345-192.168.203.43@tcp:101:lsof.0 00010000:00010000:2.0:1788837397.055904:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837397.055922:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc45 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837397.055982:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837397.055996:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837397.056007:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837397.056038:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837397.056042:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837397.056117:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837397.056142:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc45 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837397.056161:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc45 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837397.056171:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:2.0:1788837397.056174:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837397.056178:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb46aa4a00, rc 0) 00000100:00100000:2.0:1788837397.056283:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:11059:x1875731688780928:12345-192.168.203.43@tcp:101:lsof.0 Request processed in 402us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837397.056290:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00080000:3.0:1788837397.056425:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837397.222729:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837398.245536:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837398.332555:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837398.332606:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837398.332774:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688781056 00000100:00100000:3.0:1788837398.332777:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688781312 00000100:00100000:2.0:1788837398.332785:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688781056 00000100:00100000:3.0:1788837398.332831:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688781312 00000100:00100000:2.0:1788837398.332848:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 287 00000100:00100000:2.0:1788837398.332861:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688781056:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837398.332919:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:2.0:1788837398.332935:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688781056:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 75us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837398.332955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 287 00000100:00100000:3.0:1788837398.333045:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688781312:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:2.0:1788837398.333121:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837398.333130:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688781312:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 93us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837398.333141:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:1.0:1788837398.350798:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837398.350859:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837398.350892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837398.350933:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688781440 00000100:00100000:1.0:1788837398.350948:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688781440 00000100:00100000:0.0:1788837398.350984:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688781568 00000100:00100000:0.0:1788837398.350998:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688781568 00000100:00100000:1.0:1788837398.351020:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:1.0:1788837398.351035:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688781440:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837398.351059:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688781184 00000100:00100000:0.0:1788837398.351064:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688781184 00000100:00100000:0.0:1788837398.351122:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:1.0:1788837398.351129:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688781440:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837398.351140:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2361:x1875731688781568:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837398.351156:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00080000:1.0:1788837398.351196:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837398.351202:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837398.351218:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:0.0:1788837398.351225:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2361:x1875731688781568:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 85us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837398.351236:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:2361:x1875731688781184:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837398.351257:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:1.0:1788837398.351293:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:2361:x1875731688781184:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 60us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837398.351331:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:3.0:1788837398.373768:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708709632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837398.373866:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837398.374089:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708709632 00000100:00100000:2.0:1788837398.374099:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708709632 00000100:00100000:2.0:1788837398.374177:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788837398.374189:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708709632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837398.374252:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837398.374330:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708709632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837398.374338:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788837398.374469:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837398.374522:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708709632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837398.375113:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708709760:0@lo:400:kworker.0 00000100:00100000:2.0:1788837398.375159:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837398.375189:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837398.375196:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708709888:0@lo:400:kworker.0 00000100:00100000:2.0:1788837398.375224:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837398.375254:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708709760 00000100:00100000:2.0:1788837398.375259:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708709760 00000100:00100000:2.0:1788837398.375295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788837398.375322:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708709760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837398.375365:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708709760:12345-0@lo:400:kworker.0 Request processed in 64us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837398.375373:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788837398.375409:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708709760:0@lo:400:kworker.0 00000100:00100000:2.0:1788837398.375439:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708709888 00000100:00100000:2.0:1788837398.375443:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708709888 00000100:00100000:2.0:1788837398.375469:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788837398.375475:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708709888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837398.375601:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708710272:0@lo:400:kworker.0 00000100:00100000:1.0:1788837398.375633:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837398.375850:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708710144:0@lo:400:kworker.0 00000100:00100000:3.0:1788837398.375905:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837398.375936:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837398.375943:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708710016:0@lo:400:kworker.0 00000100:00100000:2.0:1788837398.376129:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708709888:12345-0@lo:400:kworker.0 Request processed in 653us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837398.376138:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788837398.376149:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708710272 00000100:00100000:2.0:1788837398.376160:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708710272 00000100:00100000:2.0:1788837398.376195:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788837398.376201:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708710272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837398.376231:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708710272:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837398.376237:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1788837398.376268:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837398.376331:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837398.378233:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708710016 00000100:00100000:2.0:1788837398.378247:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708710016 00000100:00100000:2.0:1788837398.378330:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788837398.378340:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708710016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837398.378421:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708710016:12345-0@lo:400:kworker.0 Request processed in 83us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837398.378429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788837398.378449:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837398.379455:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708710144 00000100:00100000:1.0:1788837398.379466:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708710144 00000100:00100000:1.0:1788837398.379531:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837398.379540:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708710144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837398.379604:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708710144:12345-0@lo:400:kworker.0 Request processed in 66us (3698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837398.379612:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788837398.381291:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837398.381380:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708710272:0@lo:400:kworker.0 00000100:00100000:1.0:1788837398.381399:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708709888:0@lo:400:kworker.0 00000100:00100000:3.0:1788837398.383503:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708710016:0@lo:400:kworker.0 00000100:00100000:3.0:1788837398.383524:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708710144:0@lo:400:kworker.0 00000001:00080000:1.0:1788837398.454105:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788837398.454119:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788837398.454193:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788837398.454203:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788837399.269596:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837400.293705:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837400.426211:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708710400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837400.426276:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837400.427809:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708710400 00000100:00100000:2.0:1788837400.427827:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708710400 00000100:00100000:2.0:1788837400.427903:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788837400.427915:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708710400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837400.427959:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837400.428042:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708710400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837400.428050:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788837400.428365:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708710400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788837400.428432:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837401.325989:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837401.965072:0:12365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:16:41 (1788837401) 00010000:00010000:2.0:1788837402.341795:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837403.164457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837403.164708:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688781824 00000100:00100000:2.0:1788837403.164731:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688781824 00000100:00100000:2.0:1788837403.164844:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:2.0:1788837403.164855:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:11325:x1875731688781824:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837403.164874:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837403.164904:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305cee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc4c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.167887:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.167919:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.167933:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168018:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168026:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168033:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168289:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542400/0x843cbef8be305d03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168299:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542400/0x843cbef8be305d03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168326:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542400/0x843cbef8be305d03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837403.168343:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788837403.168478:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168487:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168494:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168714:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837403.168721:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168730:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168742:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9acb454cea00) 00010000:00010000:2.0:1788837403.168745:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837403.168749:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168754:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5200/0x843cbef8be305cf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168768:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168773:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168789:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168794:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837403.168797:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168803:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168810:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9acb454ce900) 00010000:00010000:2.0:1788837403.168812:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837403.168815:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.168820:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305cfc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.170466:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4400/0x843cbef8be305cee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc4c expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.170488:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542400/0x843cbef8be305d03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc4c expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.170497:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:2.0:1788837403.170500:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837403.171376:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542400, rc 0) 00000100:00100000:2.0:1788837403.171464:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:11325:x1875731688781824:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 6610us (7014us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788837403.171487:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00080000:1.0:1788837403.172540:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837403.175165:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837403.175550:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688781952 00000100:00100000:0.0:1788837403.175566:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688781952 00000100:00100000:0.0:1788837403.175649:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:0.0:1788837403.175662:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:11325:x1875731688781952:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788837403.175776:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:11325:x1875731688781952:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 118us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837403.175784:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:3.0:1788837403.176259:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837403.176529:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688782080 00000100:00100000:2.0:1788837403.176539:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688782080 00000100:00100000:2.0:1788837403.176599:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1788837403.176611:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:2358:x1875731688782080:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837403.176630:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837403.176663:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542400/0x843cbef8be305d03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc4c expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837403.176686:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:2.0:1788837403.176693:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837403.176750:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:2358:x1875731688782080:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 142us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837403.176758:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00010000:00010000:1.0:1788837403.366089:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837403.447287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837403.447374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837403.447415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837403.447438:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837403.447479:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688782336 00000100:00100000:3.0:1788837403.447491:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688782336 00000100:00100000:3.0:1788837403.447557:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688782464 00000100:00100000:3.0:1788837403.447560:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688782464 00000100:00100000:3.0:1788837403.447585:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:3.0:1788837403.447597:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688782336:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837403.447690:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688782336:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 95us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837403.447698:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:3.0:1788837403.447716:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:3.0:1788837403.447722:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688782464:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837403.447747:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688782464:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837403.447753:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00080000:3.0:1788837403.447769:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837403.447773:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837403.447992:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688782592 00000100:00100000:2.0:1788837403.447997:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688782592 00000100:00100000:2.0:1788837403.448062:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:2.0:1788837403.448071:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2361:x1875731688782592:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837403.448109:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2361:x1875731688782592:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837403.448116:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00080000:3.0:1788837403.448496:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837403.448873:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688782208 00000100:00100000:0.0:1788837403.448881:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688782208 00000100:00100000:0.0:1788837403.448937:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 289 00000100:00100000:0.0:1788837403.448946:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688782208:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837403.448993:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688782208:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 47us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837403.449001:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 289 00000100:00100000:2.0:1788837403.494541:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708710528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837403.494639:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837403.495114:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708710784:0@lo:400:kworker.0 00000100:00100000:0.0:1788837403.495119:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708710912:0@lo:400:kworker.0 00000100:00100000:1.0:1788837403.495152:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837403.495188:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708710784 00000100:00100000:0.0:1788837403.495197:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708710784 00000100:00100000:1.0:1788837403.495216:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837403.495243:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708710912 00000100:00100000:0.0:1788837403.495246:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708710912 00000100:00100000:1.0:1788837403.495258:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788837403.495269:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708710784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837403.495275:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788837403.495280:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708710912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837403.495349:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708710784:12345-0@lo:400:kworker.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837403.495349:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708710912:12345-0@lo:400:kworker.0 Request processed in 68us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837403.495357:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788837403.495415:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708710912:0@lo:400:kworker.0 00000100:00100000:1.0:1788837403.495457:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708710784:0@lo:400:kworker.0 00000100:00100000:0.0:1788837403.495718:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788837403.495754:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708710656:0@lo:400:kworker.0 00000100:00100000:3.0:1788837403.495796:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837403.495831:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708711168:0@lo:400:kworker.0 00000100:00100000:3.0:1788837403.495855:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837403.495885:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837403.495899:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708711040:0@lo:400:kworker.0 00000100:00100000:3.0:1788837403.495927:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788837403.496184:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837403.496353:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708711040 00000100:00100000:3.0:1788837403.496359:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708711040 00000100:00100000:3.0:1788837403.496416:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788837403.496425:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708711040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837403.496485:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708711040:12345-0@lo:400:kworker.0 Request processed in 61us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837403.496492:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788837403.496596:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708711168 00000100:00100000:3.0:1788837403.496600:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708711168 00000100:00100000:3.0:1788837403.496626:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788837403.496633:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708711168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837403.496665:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708711168:12345-0@lo:400:kworker.0 Request processed in 33us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837403.496668:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708710656 00000100:00100000:3.0:1788837403.496672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788837403.496672:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708710656 00000100:00080000:3.0:1788837403.496685:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837403.496688:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837403.496698:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788837403.496704:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708710656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837403.496710:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708711040:0@lo:400:kworker.0 00000100:00100000:3.0:1788837403.496721:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708711168:0@lo:400:kworker.0 00000100:00100000:0.0:1788837403.496737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708710656:12345-0@lo:400:kworker.0 Request processed in 34us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837403.496743:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708710656:0@lo:400:kworker.0 00000100:00100000:0.0:1788837403.496744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788837403.497395:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708710528 00000100:00100000:2.0:1788837403.497412:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708710528 00000100:00100000:2.0:1788837403.497473:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837403.497480:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708710528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837403.497511:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837403.497553:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708710528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837403.497559:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837403.497607:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708710528:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788837403.498450:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788837403.570889:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837403.570901:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837403.572718:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788837403.572742:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788837403.607614:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:1.0:1788837404.396236:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837405.302562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837405.302640:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688782720 00000100:00100000:2.0:1788837405.302650:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688782720 00000100:00100000:2.0:1788837405.302719:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:2.0:1788837405.302730:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:11367:x1875731688782720:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837405.302751:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837405.302772:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc53 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.302838:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.302853:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.302866:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.302879:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.302886:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.302900:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303229:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303238:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303245:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303250:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837405.303255:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303262:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303275:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:2.0:1788837405.303278:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837405.303284:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303290:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303301:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303336:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303348:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303353:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837405.303355:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303361:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303369:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9acb454ce900) 00010000:00010000:2.0:1788837405.303371:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837405.303375:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303380:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303411:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc53 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303420:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:2.0:1788837405.303422:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837405.303425:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc53 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.303433:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542600, rc 0) 00000100:00100000:2.0:1788837405.303498:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:11367:x1875731688782720:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 770us (946us total) trans 0 rc 301/301 00000100:00100000:2.0:1788837405.303514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00080000:3.0:1788837405.303741:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837405.309914:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837405.309976:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688782976 00000100:00100000:2.0:1788837405.309985:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688782976 00000100:00100000:2.0:1788837405.310046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:2.0:1788837405.310056:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:11367:x1875731688782976:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:2.0:1788837405.310127:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837405.310153:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30568f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba8c expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.310181:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:2.0:1788837405.310187:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837405.310423:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.310437:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc45 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.310445:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.310478:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc45 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.310490:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc45 expref: 5 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837405.310504:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708711296:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837405.310706:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50f9c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837405.315116:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708711296:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837405.315152:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837405.315675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837405.316683:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688783104 00000100:00100000:2.0:1788837405.316696:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688783104 00010000:00010000:2.0:1788837405.316757:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc45 expref: 6 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837405.316803:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1788837405.316813:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2360:x1875731688783104:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837405.316829:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837405.316835:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc45 expref: 6 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.316849:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc45 expref: 6 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.316869:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4a00/0x843cbef8be305ce7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc45 expref: 6 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.316884:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:2.0:1788837405.316889:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.316909:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.316932:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788837405.316960:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788837405.316960:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837405.317041:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2360:x1875731688783104:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 228us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837405.317048:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00010000:00010000:2.0:1788837405.317075:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.317083:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.317111:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.317123:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.317133:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837405.323564:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788837405.323999:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.324011:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.324019:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.324046:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837405.324051:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.324059:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.324079:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb45631c00) 00010000:00010000:2.0:1788837405.324084:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837405.324089:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.324097:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d26 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837405.324131:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af08d00a reply state 00000000341c7a8a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837405.324140:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837405.324976:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:11367:x1875731688782976:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 14915us (15063us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788837405.324986:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 140 00010000:00010000:1.0:1788837405.329387:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.329411:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.329420:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.329429:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837405.329435:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.329460:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.329483:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9acb454ce900) 00010000:00010000:1.0:1788837405.329486:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837405.329492:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.329500:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be305d2d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837405.385620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837405.387408:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688783232 00000100:00100000:0.0:1788837405.387425:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688783232 00000100:00100000:0.0:1788837405.387497:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:0.0:1788837405.387509:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:11375:x1875731688783232:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:0.0:1788837405.387533:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837405.387556:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305d34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc5a expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.387622:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305d3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.387637:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305d3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.387664:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305d3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837405.387701:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788837405.387704:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837405.387725:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305d3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.387748:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305d34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc5a expref: 15 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.387765:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305d3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc5a expref: 14 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.387773:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5300) 00010000:00010000:0.0:1788837405.387775:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837405.387778:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917be00, rc 0) 00000100:00100000:0.0:1788837405.387851:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:11375:x1875731688783232:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 344us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837405.387858:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 141 00010000:00010000:1.0:1788837405.419672:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837405.450626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837405.450693:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688783360 00000100:00100000:3.0:1788837405.450703:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688783360 00000100:00100000:3.0:1788837405.450753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:3.0:1788837405.450762:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:11381:x1875731688783360:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1788837405.450858:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837405.450879:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc61 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451544:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451561:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451572:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451585:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451591:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451598:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451676:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305d57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451683:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451702:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837405.451727:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788837405.451730:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837405.451744:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451755:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451761:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451768:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451774:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837405.451778:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451799:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451811:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5300) 00010000:00010000:3.0:1788837405.451815:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837405.451819:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451827:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451849:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451855:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451860:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451865:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837405.451867:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451874:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451882:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9acb4556dc00) 00010000:00010000:3.0:1788837405.451884:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837405.451887:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451891:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305d50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451931:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc61 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451943:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc61 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.451960:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837405.451962:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788837405.451965:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030a00, rc 0) 00000100:00100000:3.0:1788837405.452035:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:11381:x1875731688783360:12345-192.168.203.43@tcp:101:bash.0 Request processed in 1266us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837405.452044:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:0.0:1788837405.459625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837405.459708:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688783616 00000100:00100000:2.0:1788837405.459718:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688783616 00000100:00100000:2.0:1788837405.459775:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:2.0:1788837405.459785:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+15:11381:x1875731688783616:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1788837405.459806:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837405.459826:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc68 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.459969:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.459984:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.459995:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.460066:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.460074:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.460144:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837405.460846:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788837405.461003:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.461013:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.461022:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.461065:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.463808:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.463816:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.463823:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837405.463828:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.463836:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.463853:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:2.0:1788837405.463857:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837405.463861:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.463867:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be305d65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837405.463887:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d98be552 reply state 000000005ccf4093 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837405.464169:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788837405.465497:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be305d5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc68 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.465523:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc68 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.465552:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:2.0:1788837405.465556:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837405.465560:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542000, rc 0) 00000100:00100000:2.0:1788837405.465674:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11381:x1875731688783616:12345-192.168.203.43@tcp:101:bash.0 Request processed in 5889us (6057us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788837405.465684:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:1.0:1788837405.480838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:0.0:1788837405.480937:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.480950:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.480958:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.480978:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837405.480983:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.480991:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.481009:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb454ce000) 00010000:00010000:0.0:1788837405.481012:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837405.481017:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.481022:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be305d6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837405.481625:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688783744 00000100:00100000:3.0:1788837405.481636:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688783744 00000100:00100000:3.0:1788837405.481704:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:3.0:1788837405.481715:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688783744:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1788837405.481731:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837405.481748:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc6f expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837405.481772:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788837405.481791:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788837405.481795:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837405.481805:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc6f expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.481823:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc6f expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.481834:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031000, rc 0) 00000100:00100000:3.0:1788837405.481989:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688783744:12345-192.168.203.43@tcp:101:bash.0 Request processed in 275us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837405.482005:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00080000:0.0:1788837405.482364:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837405.501782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837405.501860:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688783872 00000100:00100000:3.0:1788837405.501870:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688783872 00000100:00100000:3.0:1788837405.501941:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:3.0:1788837405.501952:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:11381:x1875731688783872:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1788837405.501970:0:8306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837405.501986:0:8306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc76 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.502017:0:8306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc6f expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.502035:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837405.502040:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837405.502044:0:8306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 7 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.502076:0:8306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc6f expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.502098:0:8306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc6f expref: 7 pid: 6701 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837405.502112:0:8306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f508a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8306:1875731708711424:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837405.502220:0:8306:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42571d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837405.505530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837405.505641:0:8306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f508a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8306:1875731708711424:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837405.505674:0:8306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 7 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.505695:0:8306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030200, rc 0) 00000100:00100000:0.0:1788837405.505760:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:11381:x1875731688783872:12345-192.168.203.43@tcp:101:bash.0 Request processed in 3809us (3987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837405.505768:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1788837405.506116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688784000 00000100:00100000:1.0:1788837405.506123:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688784000 00010000:00010000:1.0:1788837405.506153:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc6f expref: 7 pid: 6701 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837405.506193:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1788837405.506202:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688784000:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837405.506555:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837405.506578:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc6f expref: 7 pid: 6701 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.506591:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc6f expref: 7 pid: 6701 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.506635:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008600959f/0x843cbef8be305d81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc6f expref: 7 pid: 6701 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.506650:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837405.506654:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837405.506662:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 6 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.506672:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 6 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.506708:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 6 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837405.506722:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb795b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1875731708711552:192.168.203.43@tcp:105: 00000100:00100000:1.0:1788837405.506786:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb480a0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837405.519605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837405.526714:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb795b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1875731708711552:192.168.203.43@tcp:105: 00010000:00010000:1.0:1788837405.526742:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837405.526806:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688784000:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 20604us (21283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837405.526817:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:2.0:1788837405.529336:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688784256 00000100:00100000:2.0:1788837405.529349:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688784256 00000100:00100000:3.0:1788837405.535746:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:3.0:1788837405.535761:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:11381:x1875731688784256:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:3.0:1788837405.537139:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11381:x1875731688784256:12345-192.168.203.43@tcp:35:bash.0 Request processed in 1375us (17537us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788837405.537157:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:3.0:1788837405.541598:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837405.541620:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708711680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837405.541690:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837405.541812:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708711680 00000100:00100000:2.0:1788837405.541820:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708711680 00000100:00100000:2.0:1788837405.541881:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788837405.541891:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708711680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837405.541942:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837405.541990:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708711680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837405.541997:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788837405.542051:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708711680:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788837405.542433:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788837405.606944:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837405.606955:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837405.607184:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788837405.607203:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837405.651649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837405.655767:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688784512 00000100:00100000:0.0:1788837405.655797:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688784512 00000100:00100000:1.0:1788837405.656052:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:1.0:1788837405.656066:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11390:x1875731688784512:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837405.656117:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837405.656137:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837405.656540:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788837405.656667:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305d8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc7d expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.656681:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5300) 00010000:00010000:1.0:1788837405.656685:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837405.656689:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc7d expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.656702:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577600, rc 0) 00000100:00100000:1.0:1788837405.656772:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:11390:x1875731688784512:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 708us (5141us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788837405.656780:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:0.0:1788837405.664928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837405.665102:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688784768 00000100:00100000:1.0:1788837405.665113:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688784768 00000100:00100000:1.0:1788837405.665172:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:1.0:1788837405.665183:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:11390:x1875731688784768:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837405.665475:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:11390:x1875731688784768:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 293us (555us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788837405.665484:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:0.0:1788837405.793427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837405.793894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688784896 00000100:00100000:3.0:1788837405.793905:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688784896 00000100:00100000:3.0:1788837405.793967:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:3.0:1788837405.793978:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:11397:x1875731688784896:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837405.794001:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837405.794020:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc84 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.794115:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.794138:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.794158:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837405.794738:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788837405.794743:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837405.794763:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.794794:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc84 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.794814:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc84 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.794823:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837405.794826:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837405.794830:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031000, rc 0) 00000100:00100000:3.0:1788837405.794900:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:11397:x1875731688784896:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 924us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837405.794908:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:0.0:1788837405.810602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837405.810803:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688785152 00000100:00100000:3.0:1788837405.810813:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688785152 00000100:00100000:3.0:1788837405.810877:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 146 00000100:00100000:3.0:1788837405.810889:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:11397:x1875731688785152:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837405.810910:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837405.810930:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305dab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc8b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.811042:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305db2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.811074:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.811086:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837405.811099:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788837405.817402:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305dab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc8b expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.817434:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc8b expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.817444:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:3.0:1788837405.817447:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837405.817452:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031800, rc 0) 00000100:00100000:3.0:1788837405.817517:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:11397:x1875731688785152:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 6629us (6923us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788837405.817526:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 146 00000100:00100000:0.0:1788837405.836560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837405.836705:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688785280 00000100:00100000:2.0:1788837405.836716:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688785280 00000100:00100000:2.0:1788837405.836784:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:2.0:1788837405.836794:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:2361:x1875731688785280:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837405.836814:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837405.836844:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305db2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc8b expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.836887:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:2.0:1788837405.836892:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837405.836949:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:2361:x1875731688785280:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 157us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837405.836957:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1788837405.840677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837405.842656:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688785536 00000100:00100000:1.0:1788837405.842670:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688785536 00000100:00100000:1.0:1788837405.842726:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:1.0:1788837405.842750:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:11397:x1875731688785536:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837405.842777:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837405.842799:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305dc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc92 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.842891:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305dc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.842907:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.842917:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837405.842930:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788837405.843081:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be305dc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc92 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.843102:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc92 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.843110:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:1.0:1788837405.843113:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788837405.843117:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577000, rc 0) 00000100:00100000:1.0:1788837405.843197:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:11397:x1875731688785536:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 449us (2527us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788837405.843204:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:3.0:1788837405.855633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837405.855860:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688785664 00000100:00100000:0.0:1788837405.855874:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688785664 00000100:00100000:0.0:1788837405.855963:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:0.0:1788837405.855976:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688785664:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:0.0:1788837405.856052:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.856079:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 6 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.856089:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837405.856095:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837405.856100:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.856148:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 6 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.856283:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 6 pid: 8306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837405.856371:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75814a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1875731708711808:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837405.856516:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f732300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837405.864618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837405.864794:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688785792 00000100:00100000:1.0:1788837405.864808:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688785792 00002000:00100000:1.0:1788837405.864914:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9acb79630e00 x1875731688785792/t0(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:61/0 lens 504/0 e 0 to 0 dl 1788837416 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837405.864927:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb79630e00 with x1875731688785792 ext(0->12) 00010000:00010000:1.0:1788837405.864953:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 7 pid: 8306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.864974:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 7 pid: 8306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837405.864984:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9acb79630e00 00000100:00100000:1.0:1788837405.865034:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:1.0:1788837405.865044:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688785792:12345-192.168.203.43@tcp:4:lfs.0 00000100:00100000:1.0:1788837405.865720:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2361:x1875731688785792:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 673us (1113us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788837405.865730:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00002000:00100000:1.0:1788837405.865738:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9acb79630e00 x1875731688785792/t4294967305(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:61/0 lens 504/448 e 0 to 0 dl 1788837416 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837405.865747:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb79630e00 with x1875731688785792 ext(0->12) 00010000:00010000:1.0:1788837405.865755:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 9 pid: 8306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837405.865769:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 9 pid: 8306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837405.865776:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9acb79630e00 00000100:00100000:0.0:1788837405.866870:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75814a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1875731708711808:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837405.866921:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837405.871259:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837405.871558:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688785920 00000100:00100000:0.0:1788837405.871573:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688785920 00010000:00010000:0.0:1788837405.871627:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 9 pid: 8306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837405.871689:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:0.0:1788837405.871701:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688785920:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837405.871721:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788837405.871747:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788837405.871751:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788837406 00002000:00010000:0.0:1788837405.871753:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788837406 00002000:00010000:0.0:1788837405.871756:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788837406 00010000:00010000:0.0:1788837405.871763:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 9 pid: 8306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.871780:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 9 pid: 8306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.871835:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009feb5d13/0x843cbef8be305d88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc76 expref: 9 pid: 8306 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.871859:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837405.871864:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837405.871872:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.871904:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.871945:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837405.872390:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688785920:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 689us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837405.872400:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00010000:00010000:3.0:1788837405.873284:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.873346:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.873391:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.873419:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.876414:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.876562:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837405.876568:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.876583:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.876611:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.876621:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067f8a592/0x843cbef8be305dd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837405.877220:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688785664:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 21238us (21594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837405.877233:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:0.0:1788837405.882587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837405.882743:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688786176 00000100:00100000:1.0:1788837405.882758:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688786176 00000100:00100000:1.0:1788837405.882842:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:1.0:1788837405.882855:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db2ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:11397:x1875731688786176:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:1.0:1788837405.883038:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc92 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837405.884788:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788837405.885628:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788837405.887737:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788837405.888137:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.888167:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc68 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.888179:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.888247:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc68 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837405.888270:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc68 expref: 28 pid: 5846 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837405.888287:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75814a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875731708711936:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837405.889264:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f732900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837405.895774:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75814a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875731708711936:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837405.895832:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837405.895931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837405.896139:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688786304 00000100:00100000:2.0:1788837405.896148:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688786304 00010000:00010000:2.0:1788837405.896198:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc68 expref: 29 pid: 5846 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837405.896286:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:2.0:1788837405.896299:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:2361:x1875731688786304:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837405.896367:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837405.896375:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc68 expref: 29 pid: 5846 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.896389:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc68 expref: 29 pid: 5846 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.896416:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305d73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc68 expref: 29 pid: 5846 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.897065:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:2.0:1788837405.897088:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.897102:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.897111:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837405.897146:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837405.897291:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:2361:x1875731688786304:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 990us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837405.897300:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00010000:00010000:3.0:1788837405.897492:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.897502:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837405.897704:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788837405.897982:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788837405.898141:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f508a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708712064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837405.898233:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837405.898273:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4904f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837405.903824:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708712064 00000100:00100000:1.0:1788837405.903847:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708712064 00000100:00100000:1.0:1788837405.904166:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837405.904179:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875731708712064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788837405.904372:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875731708712064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 196us (6138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837405.904381:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788837405.905509:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837405.908319:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f508a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708712064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788837405.910227:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788837405.910390:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75241c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708712192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837405.910555:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837405.910680:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42571d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837405.910801:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708712192 00000100:00100000:1.0:1788837405.910811:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708712192 00000100:00100000:1.0:1788837405.911458:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837405.911471:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875731708712192:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788837405.911784:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1875731708712192:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 315us (1229us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788837405.911794:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837405.911911:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75241c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708712192:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788837405.913291:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788837405.913400:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.913417:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.913438:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.913466:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837405.913472:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.913482:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.913503:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:3.0:1788837405.913507:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788837405.913512:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.913518:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305ddc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837405.913833:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788837405.914401:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788837405.914418:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359765113157ns, next at 360765110139ns, rc = 0 00000001:00080000:3.0:1788837405.914441:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788837405.914492:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:3.0:1788837405.914497:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788837405.914508:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305dc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc92 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837405.915240:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db2ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:11397:x1875731688786176:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 32382us (32663us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788837405.915253:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000020:00080000:3.0:1788837405.915260:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788837405.922654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837405.922832:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688786432 00000100:00100000:3.0:1788837405.922845:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688786432 00000100:00100000:3.0:1788837405.923207:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:3.0:1788837405.923223:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:11397:x1875731688786432:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837405.923253:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837405.923282:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305de3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbc99 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.923413:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305de3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc99 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.923492:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305de3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc99 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837405.923517:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:3.0:1788837405.923520:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837405.923524:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40031a00, rc 0) 00000100:00100000:3.0:1788837405.923800:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:11397:x1875731688786432:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 580us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837405.923808:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:2.0:1788837405.929714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837405.929807:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688786688 00000100:00100000:3.0:1788837405.930079:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688786688 00000100:00100000:3.0:1788837405.930203:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1788837405.930214:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:11397:x1875731688786688:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1788837405.930551:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+33:11397:x1875731688786688:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 338us (852us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788837405.930559:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1788837406.064744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837406.065150:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688786944 00000100:00100000:3.0:1788837406.065164:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688786944 00000100:00100000:3.0:1788837406.065240:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 149 00000100:00100000:3.0:1788837406.065251:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+33:11407:x1875731688786944:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837406.065284:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837406.065357:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305dea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbca0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837406.065477:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788837406.065654:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305dea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca0 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.065673:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5300) 00010000:00010000:3.0:1788837406.065944:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837406.065952:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305dea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca0 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.065973:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb40030600, rc 0) 00000100:00100000:3.0:1788837406.066073:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:11407:x1875731688786944:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 822us (1343us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788837406.066081:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 149 00000100:00100000:1.0:1788837406.068943:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837406.077704:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688787072 00000100:00100000:0.0:1788837406.077727:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688787072 00000100:00100000:0.0:1788837406.077830:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 150 00000100:00100000:0.0:1788837406.077842:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:11407:x1875731688787072:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1788837406.077959:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.077980:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.077993:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078011:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078017:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078057:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078172:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078181:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078189:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837406.078241:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078257:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078263:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078271:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078277:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837406.078282:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078291:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078345:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:0.0:1788837406.078357:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837406.078364:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078372:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305df8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078392:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078399:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078405:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078411:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837406.078414:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078420:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078428:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb50df5a00) 00010000:00010000:0.0:1788837406.078434:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837406.078437:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078442:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305dff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078458:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078469:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078474:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078479:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837406.078482:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078488:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078496:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:0.0:1788837406.078498:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837406.078501:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.078507:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837406.079098:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:11407:x1875731688787072:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1253us (10167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837406.079108:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 150 00000100:00100000:1.0:1788837406.082791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837406.083597:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688787328 00000100:00100000:0.0:1788837406.083613:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688787328 00000100:00100000:0.0:1788837406.083701:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1788837406.083712:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:11407:x1875731688787328:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1788837406.084555:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:11407:x1875731688787328:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 840us (1773us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788837406.084761:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:2.0:1788837406.136390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837406.136609:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688787584 00000100:00100000:3.0:1788837406.136624:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688787584 00000100:00100000:3.0:1788837406.136705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 151 00000100:00100000:3.0:1788837406.136717:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:11410:x1875731688787584:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837406.136747:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837406.136777:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305e0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbca7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.136914:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.136940:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.136954:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.136971:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.136978:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.136985:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137146:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137155:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137162:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837406.137550:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788837406.137693:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137703:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137719:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137725:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40030200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837406.137730:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137738:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137753:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837406.137756:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837406.137761:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137767:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030200/0x843cbef8be305e14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137786:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137792:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.137798:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.138529:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb40031800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837406.138535:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.138556:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.138579:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb4556de00) 00010000:00010000:3.0:1788837406.138582:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837406.138585:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.138592:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031800/0x843cbef8be305e1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.138665:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030600/0x843cbef8be305e0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca7 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.138682:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca7 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.138699:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:3.0:1788837406.138702:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837406.138705:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2800, rc 0) 00000100:00100000:3.0:1788837406.138799:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:11410:x1875731688787584:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2083us (2423us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788837406.138821:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 151 00000100:00100000:1.0:1788837406.144191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837406.144344:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688787712 00000100:00100000:2.0:1788837406.144359:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688787712 00000100:00100000:2.0:1788837406.144440:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:2.0:1788837406.144454:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:11410:x1875731688787712:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1788837406.144548:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.144570:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.144583:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.144615:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.144642:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.144650:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.144656:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837406.144661:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.144669:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.144683:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:2.0:1788837406.144687:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837406.144693:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.144700:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305e30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837406.144797:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:11410:x1875731688787712:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 345us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837406.144805:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:1.0:1788837406.148182:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837406.148408:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688787968 00000100:00100000:3.0:1788837406.148421:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688787968 00000100:00100000:3.0:1788837406.148494:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:3.0:1788837406.148506:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:11410:x1875731688787968:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1788837406.148866:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:11410:x1875731688787968:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 359us (696us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788837406.148875:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00010000:00010000:1.0:1788837406.438166:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837406.496496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837406.500642:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688788224 00000100:00100000:0.0:1788837406.500669:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688788224 00000100:00100000:0.0:1788837406.500809:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:0.0:1788837406.500824:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:11441:x1875731688788224:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:0.0:1788837406.500861:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837406.500903:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcae expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.501067:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305e3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.501087:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.501103:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837406.501116:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788837406.501282:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcae expref: 41 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.501380:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305e3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcae expref: 40 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.501391:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:0.0:1788837406.501394:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837406.501399:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917b400, rc 0) 00000100:00100000:0.0:1788837406.501505:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:11441:x1875731688788224:12345-192.168.203.43@tcp:101:cat.0 Request processed in 684us (5023us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788837406.501513:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:1.0:1788837406.509838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837406.510104:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688788480 00000100:00100000:3.0:1788837406.510117:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688788480 00000100:00100000:3.0:1788837406.510186:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:3.0:1788837406.510196:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:11441:x1875731688788480:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:3.0:1788837406.510546:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:11441:x1875731688788480:12345-192.168.203.43@tcp:35:cat.0 Request processed in 345us (719us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788837406.510555:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:1.0:1788837406.534251:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837406.534470:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688788608 00000100:00100000:0.0:1788837406.534495:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688788608 00000100:00100000:0.0:1788837406.534585:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1788837406.534596:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:2360:x1875731688788608:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837406.534611:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837406.534635:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305e3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcae expref: 41 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837406.534653:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:0.0:1788837406.534659:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837406.534999:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:2360:x1875731688788608:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 404us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837406.535008:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1788837406.618569:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837406.618604:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688788864 00000100:00100000:3.0:1788837406.618616:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688788864 00000100:00100000:3.0:1788837406.618671:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 154 00000100:00100000:3.0:1788837406.618680:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:11448:x1875731688788864:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:3.0:1788837406.618828:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837406.618831:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788837406.618859:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031000/0x843cbef8be305da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc84 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.618880:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837406.618885:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837406.618898:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236400/0x843cbef8be305e4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcb5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.619192:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.619208:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca7 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.619217:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.619252:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca7 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.619266:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca7 expref: 40 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837406.619281:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb754e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708712320:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837406.619447:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837406.626947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837406.626980:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688788992 00000100:00100000:3.0:1788837406.626988:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688788992 00010000:00010000:3.0:1788837406.627035:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca7 expref: 41 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837406.627071:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:3.0:1788837406.627081:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb6a6de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:2361:x1875731688788992:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837406.627096:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837406.627116:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca7 expref: 41 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.627129:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca7 expref: 41 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.627150:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:3.0:1788837406.627155:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.627164:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.627171:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837406.627190:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837406.627238:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb6a6de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:2361:x1875731688788992:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 158us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837406.627246:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00010000:00010000:2.0:1788837406.628671:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be305e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbca7 expref: 40 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837406.628694:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb754e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708712320:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837406.628744:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.628765:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.628772:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837406.628791:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788837406.628954:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236400/0x843cbef8be305e4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcb5 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.628969:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcb5 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.628978:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:2.0:1788837406.628981:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837406.628984:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236e00, rc 0) 00000100:00100000:2.0:1788837406.629047:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:11448:x1875731688788864:12345-192.168.203.43@tcp:101:dd.0 Request processed in 10367us (10488us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788837406.629056:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 154 00000001:00080000:3.0:1788837406.633494:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1788837406.633509:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788837406.642210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837406.642517:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688789248 00000100:00100000:2.0:1788837406.642529:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688789248 00000100:00100000:2.0:1788837406.642591:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 155 00000100:00100000:2.0:1788837406.642601:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb754e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:11448:x1875731688789248:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:2.0:1788837406.642872:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.642890:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837406.642914:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837406.642984:0:7291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788837406.643009:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b34a3179 reply state 00000000635688ae transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837406.643028:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837406.643120:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb754e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+43:11448:x1875731688789248:12345-192.168.203.43@tcp:36:dd.0 Request processed in 518us (919us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788837406.643128:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 155 00000020:00080000:2.0:1788837406.643133:0:7291:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837406.646823:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837406.646842:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837406.646849:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837406.646855:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837406.646860:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837406.646868:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837406.646884:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:1.0:1788837406.646896:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837406.646902:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837406.646908:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305e61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837407.115211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837407.115533:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688789376 00000100:00100000:2.0:1788837407.115543:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688789376 00000100:00100000:2.0:1788837407.115619:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 156 00000100:00100000:2.0:1788837407.115629:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+42:11462:x1875731688789376:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:2.0:1788837407.115649:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837407.115669:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcbc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115730:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115745:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115755:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115788:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115796:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115803:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115888:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115899:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcb5 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115906:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115936:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcb5 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.115951:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcb5 expref: 43 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837407.115965:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708712448:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837407.116068:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb75496900 going to sleep for 11 seconds 00000100:00080000:3.0:1788837407.116471:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837407.119287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837407.119401:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688789632 00000100:00100000:1.0:1788837407.119410:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688789632 00000100:00100000:1.0:1788837407.119466:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1788837407.119475:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+44:5596:x1875731688789632:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788837407.119780:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+45:5596:x1875731688789632:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 306us (503us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788837407.119802:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:2.0:1788837407.120707:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708712448:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837407.120736:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837407.124394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837407.124489:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688789760 00000100:00100000:2.0:1788837407.124498:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688789760 00010000:00010000:2.0:1788837407.124536:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcb5 expref: 45 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837407.124577:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:2.0:1788837407.124587:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+45:2360:x1875731688789760:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837407.124602:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837407.124608:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcb5 expref: 45 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.124620:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcb5 expref: 45 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.124642:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be305e53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcb5 expref: 45 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.124658:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:2.0:1788837407.124663:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.124673:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.124681:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.124712:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837407.124784:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+44:2360:x1875731688789760:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 197us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837407.124793:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00010000:00010000:3.0:1788837407.125163:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125173:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837407.125217:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788837407.125221:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837407.125240:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125252:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125261:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125268:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125275:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125280:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837407.125285:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125292:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125344:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837407.125348:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837407.125352:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125359:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305e6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125381:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125387:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125393:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125398:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837407.125402:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125408:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125416:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb454ce300) 00010000:00010000:3.0:1788837407.125418:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837407.125421:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125427:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305e76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125462:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcbc expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125475:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcbc expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.125493:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:3.0:1788837407.125495:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837407.125497:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543200, rc 0) 00000100:00100000:3.0:1788837407.125545:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+43:11462:x1875731688789376:12345-192.168.203.43@tcp:101:stat.0 Request processed in 9917us (10342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837407.125552:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 156 00000100:00100000:1.0:1788837407.219386:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837407.219452:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688790016 00000100:00100000:2.0:1788837407.219461:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688790016 00000100:00100000:2.0:1788837407.219528:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 157 00000100:00100000:2.0:1788837407.219539:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+43:11468:x1875731688790016:12345-192.168.203.43@tcp:36:truncate.0 00010000:00010000:2.0:1788837407.219595:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837407.219633:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305e7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcbc expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.219650:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:2.0:1788837407.219654:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837407.219841:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.219854:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.219865:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837407.219915:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788837407.219941:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f623588 reply state 000000007fa81ef0 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837407.219950:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837407.220064:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+45:11468:x1875731688790016:12345-192.168.203.43@tcp:36:truncate.0 Request processed in 526us (686us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788837407.220071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 157 00000020:00080000:2.0:1788837407.220087:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788837407.224332:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.224350:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.224357:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.224363:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837407.224367:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.224391:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.224407:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:0.0:1788837407.224410:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837407.224414:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.224421:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be305e84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837407.391434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837407.391578:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688790144 00000100:00100000:0.0:1788837407.391587:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688790144 00000100:00100000:0.0:1788837407.391639:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 158 00000100:00100000:0.0:1788837407.391647:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+44:11482:x1875731688790144:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:0.0:1788837407.391668:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837407.391688:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305e8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcc3 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.391821:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.391835:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.391846:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.391861:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.391887:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.391894:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.391973:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.391981:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.391989:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837407.392033:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788837407.392038:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837407.392061:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392073:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392082:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392088:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392094:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392110:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837407.392115:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392123:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392135:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:0.0:1788837407.392139:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837407.392143:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392149:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305e92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392162:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392168:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392174:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392179:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837407.392182:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392188:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392207:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb50df5400) 00010000:00010000:0.0:1788837407.392209:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837407.392212:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392218:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392247:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305e8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcc3 expref: 46 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392260:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcc3 expref: 45 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.392266:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:0.0:1788837407.392269:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837407.392271:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917aa00, rc 0) 00000100:00100000:0.0:1788837407.392442:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+45:11482:x1875731688790144:12345-192.168.203.43@tcp:101:stat.0 Request processed in 795us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837407.392450:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 158 00010000:00010000:1.0:1788837407.461675:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837407.490948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837407.491101:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688790400 00000100:00100000:3.0:1788837407.491111:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688790400 00000100:00100000:3.0:1788837407.491171:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 159 00000100:00100000:3.0:1788837407.491182:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+45:11492:x1875731688790400:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837407.491202:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837407.491221:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236800/0x843cbef8be305ea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837407.491330:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788837407.491453:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236800/0x843cbef8be305ea7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcca expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.491468:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5300) 00010000:00010000:3.0:1788837407.491471:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837407.491476:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236800/0x843cbef8be305ea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcca expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.491491:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236800, rc 0) 00000100:00100000:3.0:1788837407.491556:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+46:11492:x1875731688790400:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 376us (618us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788837407.491579:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 159 00000100:00100000:1.0:1788837407.496612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837407.496893:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688790656 00000100:00100000:3.0:1788837407.496903:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688790656 00000100:00100000:3.0:1788837407.496960:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:3.0:1788837407.496970:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+46:11492:x1875731688790656:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1788837407.497203:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:11492:x1875731688790656:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 234us (599us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788837407.497210:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1788837407.579123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837407.579277:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688790912 00000100:00100000:2.0:1788837407.579288:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688790912 00000100:00100000:2.0:1788837407.579383:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 160 00000100:00100000:2.0:1788837407.579394:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:11498:x1875731688790912:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1788837407.579417:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837407.579437:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305eb5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcd1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.579530:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.579545:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcc3 expref: 48 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.579554:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.579586:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcc3 expref: 48 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.579601:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcc3 expref: 48 pid: 11703 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837407.579614:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708712576:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837407.579704:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb75496e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837407.584269:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79141c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708712576:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837407.584299:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837407.585868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837407.586095:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688791040 00000100:00100000:3.0:1788837407.586104:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688791040 00010000:00010000:3.0:1788837407.586141:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcc3 expref: 49 pid: 11703 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837407.586189:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:3.0:1788837407.586199:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+49:2361:x1875731688791040:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837407.586213:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837407.586221:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcc3 expref: 49 pid: 11703 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.586233:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcc3 expref: 49 pid: 11703 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.586255:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be305ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcc3 expref: 49 pid: 11703 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.586271:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:3.0:1788837407.586288:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.586298:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.586348:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.586376:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837407.586424:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79051f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+48:2361:x1875731688791040:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 226us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837407.586431:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00010000:00010000:1.0:1788837407.587066:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.587075:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837407.587103:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788837407.587249:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be305eb5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd1 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.587264:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd1 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.587272:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:1.0:1788837407.587275:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837407.587278:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542200, rc 0) 00000100:00100000:1.0:1788837407.587352:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+48:11498:x1875731688790912:12345-192.168.203.43@tcp:101:bash.0 Request processed in 7959us (8238us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788837407.587360:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 160 00000100:00100000:1.0:1788837407.591833:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837407.591912:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688791296 00000100:00100000:0.0:1788837407.591930:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688791296 00000100:00100000:0.0:1788837407.591983:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:0.0:1788837407.591993:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+48:11498:x1875731688791296:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:0.0:1788837407.592283:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.592299:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.592368:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837407.592423:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788837407.592448:0:11703:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba20b72c reply state 000000007bc19963 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837407.592456:0:11703:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837407.592539:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:11498:x1875731688791296:12345-192.168.203.43@tcp:36:bash.0 Request processed in 547us (714us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788837407.592546:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 161 00000020:00080000:0.0:1788837407.592551:0:11703:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788837407.597864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:1.0:1788837407.598042:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.598054:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.598061:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.598067:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837407.598072:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.598078:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.598094:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:1.0:1788837407.598097:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837407.598101:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.598107:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be305eca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837407.598250:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688791424 00000100:00100000:0.0:1788837407.598259:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688791424 00000100:00100000:0.0:1788837407.598322:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:0.0:1788837407.598332:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:11498:x1875731688791424:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837407.598350:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837407.598366:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305ed1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcd8 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.598439:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.598452:0:7291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd1 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.598459:0:7291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.598505:0:7291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd1 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.598518:0:7291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd1 expref: 51 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837407.598530:0:7291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75814380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7291:1875731708712704:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837407.598599:0:7291:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f732000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837407.601257:0:7291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75814380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7291:1875731708712704:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837407.601284:0:7291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837407.601813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837407.602099:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688791552 00000100:00100000:2.0:1788837407.602106:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688791552 00010000:00010000:2.0:1788837407.602155:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd1 expref: 52 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837407.602200:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:2.0:1788837407.602213:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:2360:x1875731688791552:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837407.602233:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837407.602243:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd1 expref: 52 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.602260:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd1 expref: 52 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.602289:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305ebc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd1 expref: 52 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.602350:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:2.0:1788837407.602358:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.602368:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.602381:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.602404:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837407.602488:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:2360:x1875731688791552:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 274us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837407.602501:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00010000:00010000:0.0:1788837407.603210:0:7291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.603219:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837407.603260:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788837407.603264:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837407.603284:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.603417:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305ed1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd8 expref: 51 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.603436:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd8 expref: 50 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.603458:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:0.0:1788837407.603461:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837407.603463:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917b000, rc 0) 00000100:00100000:0.0:1788837407.603537:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:11498:x1875731688791424:12345-192.168.203.43@tcp:101:bash.0 Request processed in 5206us (5680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837407.603543:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:3.0:1788837407.606086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837407.606250:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688791808 00000100:00100000:1.0:1788837407.606259:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688791808 00000100:00100000:0.0:1788837407.606397:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1788837407.606409:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:11498:x1875731688791808:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:0.0:1788837407.606619:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:11498:x1875731688791808:12345-192.168.203.43@tcp:35:bash.0 Request processed in 213us (539us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788837407.606627:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:1.0:1788837407.688081:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837407.688247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688792064 00000100:00100000:2.0:1788837407.688257:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688792064 00000100:00100000:2.0:1788837407.688388:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:2.0:1788837407.688399:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:11508:x1875731688792064:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837407.688423:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837407.688443:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305edf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcdf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837407.688547:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788837407.688655:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305edf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcdf expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.688669:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5300) 00010000:00010000:2.0:1788837407.688671:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837407.688676:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be305edf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcdf expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.688687:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542200, rc 0) 00000100:00100000:2.0:1788837407.688748:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:11508:x1875731688792064:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 349us (673us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788837407.688756:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:3.0:1788837407.691981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837407.692044:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688792192 00000100:00100000:2.0:1788837407.692053:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688792192 00000100:00100000:2.0:1788837407.692109:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:2.0:1788837407.692118:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:11508:x1875731688792192:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:2.0:1788837407.692204:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692220:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692230:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692242:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692248:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692254:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692356:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692364:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692372:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837407.692411:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692423:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692441:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692448:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692454:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837407.692458:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692466:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692478:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:2.0:1788837407.692481:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837407.692486:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692492:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692505:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692511:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692517:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692522:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837407.692531:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692537:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692545:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb454ce100) 00010000:00010000:2.0:1788837407.692548:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837407.692551:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692556:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be305ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692569:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692575:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692580:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692585:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837407.692588:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692593:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692601:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:2.0:1788837407.692603:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837407.692612:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.692618:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be305efb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837407.693031:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:11508:x1875731688792192:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 911us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837407.693040:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:3.0:1788837407.695155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837407.695481:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688792448 00000100:00100000:0.0:1788837407.695491:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688792448 00000100:00100000:0.0:1788837407.695572:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1788837407.695582:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:11508:x1875731688792448:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1788837407.695794:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+53:11508:x1875731688792448:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 213us (645us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788837407.695801:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:1.0:1788837407.729967:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837407.730075:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688792704 00000100:00100000:0.0:1788837407.730084:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688792704 00000100:00100000:0.0:1788837407.730141:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:0.0:1788837407.730152:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+53:11511:x1875731688792704:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837407.730389:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837407.730420:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305f02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbce6 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730492:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730507:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730517:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730530:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730537:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730543:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730656:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be305f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730665:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be305f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730672:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be305f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837407.730681:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788837407.730778:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730795:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730801:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730808:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837407.730811:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730819:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730831:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:0.0:1788837407.730833:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837407.730838:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730844:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be305f09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730858:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730863:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730869:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730874:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ae00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837407.730882:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730889:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730896:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb50df5400) 00010000:00010000:0.0:1788837407.730899:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837407.730901:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730907:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730948:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305f02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbce6 expref: 56 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730959:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be305f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbce6 expref: 55 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.730967:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:0.0:1788837407.730969:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837407.730971:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917ba00, rc 0) 00000100:00100000:0.0:1788837407.731478:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:11511:x1875731688792704:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1017us (1208us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788837407.731488:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:2.0:1788837407.735114:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837407.735253:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688792832 00000100:00100000:1.0:1788837407.735262:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688792832 00000100:00100000:1.0:1788837407.735338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:1.0:1788837407.735349:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:11511:x1875731688792832:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:1.0:1788837407.735425:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.735441:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.735451:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.735480:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.735488:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.735494:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.735499:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837407.735503:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.735510:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.735522:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:1.0:1788837407.735525:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837407.735529:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837407.735535:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be305f25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837407.735617:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:11511:x1875731688792832:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 269us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837407.735626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:2.0:1788837407.736049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837407.736115:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688792960 00000100:00100000:3.0:1788837407.736120:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688792960 00000100:00100000:3.0:1788837407.736160:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1788837407.736178:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:2358:x1875731688792960:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837407.736191:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837407.736209:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be305f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbce6 expref: 55 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.736221:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:3.0:1788837407.736224:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837407.736257:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:2358:x1875731688792960:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 91us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837407.736271:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1788837407.738955:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837407.739027:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688793216 00000100:00100000:1.0:1788837407.739035:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688793216 00000100:00100000:1.0:1788837407.739088:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:1.0:1788837407.739098:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:11511:x1875731688793216:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837407.739345:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:11511:x1875731688793216:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 248us (398us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788837407.739353:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:2.0:1788837407.934622:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837407.935757:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688793472 00000100:00100000:3.0:1788837407.935770:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688793472 00000100:00100000:3.0:1788837407.935836:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:3.0:1788837407.935846:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:11529:x1875731688793472:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1788837407.935868:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837407.936061:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbced expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.936195:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236800/0x843cbef8be305f33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.936209:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236800/0x843cbef8be305f33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.936220:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236800/0x843cbef8be305f33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837407.936231:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788837407.936370:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbced expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.936390:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236800/0x843cbef8be305f33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbced expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837407.936398:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:3.0:1788837407.936401:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788837407.936411:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236800, rc 0) 00000100:00100000:3.0:1788837407.936474:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:11529:x1875731688793472:12345-192.168.203.43@tcp:101:cat.0 Request processed in 629us (1862us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788837407.936481:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:1.0:1788837407.967687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837407.967788:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688793600 00000100:00100000:0.0:1788837407.967798:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688793600 00000100:00100000:0.0:1788837407.967854:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:0.0:1788837407.967864:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:11530:x1875731688793600:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837407.967909:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837407.968071:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305f41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcf4 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.968137:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.968150:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.968162:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837407.968366:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788837407.968370:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837407.968386:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.968411:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be305f41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcf4 expref: 59 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.968428:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcf4 expref: 58 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.968436:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:0.0:1788837407.968439:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837407.968442:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917ae00, rc 0) 00000100:00100000:0.0:1788837407.968503:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+58:11530:x1875731688793600:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 640us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837407.968519:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:1.0:1788837407.986401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837407.986500:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688793984 00000100:00100000:3.0:1788837407.986510:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688793984 00000100:00100000:3.0:1788837407.986560:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:3.0:1788837407.986570:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+58:11530:x1875731688793984:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1788837407.986876:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:11530:x1875731688793984:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 306us (483us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788837407.986883:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:2.0:1788837407.989988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837407.994402:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688794112 00000100:00100000:0.0:1788837407.994416:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688794112 00000100:00100000:0.0:1788837407.994496:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1788837407.994507:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:11530:x1875731688794112:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:0.0:1788837407.994524:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788837407.994551:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be305ed8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcd8 expref: 59 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.994576:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236800/0x843cbef8be305f33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbced expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.994590:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031a00/0x843cbef8be305de3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc99 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837407.994600:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb4556dc00) 00010000:00010000:0.0:1788837407.994610:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837407.994677:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75194a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:11530:x1875731688794112:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 171us (4696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837407.994684:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1788837407.998977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837407.999117:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688794240 00000100:00100000:2.0:1788837407.999126:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688794240 00000100:00100000:2.0:1788837407.999181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:2.0:1788837407.999192:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:11530:x1875731688794240:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:2.0:1788837407.999353:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.999369:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837407.999379:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837407.999552:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788837407.999631:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:11530:x1875731688794240:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 441us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837407.999639:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:1.0:1788837408.042101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.042201:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688794368 00000100:00100000:3.0:1788837408.042210:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688794368 00000100:00100000:3.0:1788837408.042270:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00100000:3.0:1788837408.042280:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:11532:x1875731688794368:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837408.042299:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837408.042345:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbcfb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042412:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042425:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042435:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042448:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042469:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042476:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042561:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042569:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042575:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837408.042607:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788837408.042611:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837408.042627:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042639:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042646:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042651:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042656:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042674:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837408.042678:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042685:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042698:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837408.042701:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837408.042706:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042711:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042725:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042731:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042736:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042740:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837408.042743:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042748:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042764:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb4556de00) 00010000:00010000:3.0:1788837408.042767:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837408.042837:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042845:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.042874:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcfb expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.043070:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcfb expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.043077:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ce100) 00010000:00010000:3.0:1788837408.043079:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837408.043082:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237800, rc 0) 00000100:00100000:2.0:1788837408.043590:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:11532:x1875731688794368:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1308us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837408.043598:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 170 00010000:00010000:1.0:1788837408.485440:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837408.569889:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837408.569938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.569944:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688794496 00000100:00100000:3.0:1788837408.569955:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688794496 00000100:00100000:0.0:1788837408.569960:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837408.569977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.569998:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 291 00000100:00100000:0.0:1788837408.569998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.570018:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688794496:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837408.570028:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688794752 00000100:00100000:0.0:1788837408.570042:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688794752 00000100:00100000:0.0:1788837408.570080:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688794880 00000100:00100000:0.0:1788837408.570084:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688794880 00000100:00100000:3.0:1788837408.570086:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688794496:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.570094:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 291 00000100:00100000:0.0:1788837408.570103:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:0.0:1788837408.570109:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688794752:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:3.0:1788837408.570123:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837408.570127:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837408.570136:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688794752:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837408.570142:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:0.0:1788837408.570154:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:0.0:1788837408.570160:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688794880:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837408.570180:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688794880:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 21us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837408.570186:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:0.0:1788837408.570218:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688795008 00000100:00100000:0.0:1788837408.570222:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688795008 00000100:00080000:3.0:1788837408.570238:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837408.570253:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688794624 00000100:00100000:0.0:1788837408.570256:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688794624 00000100:00100000:0.0:1788837408.570273:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:0.0:1788837408.570279:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688795008:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837408.570321:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2361:x1875731688795008:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 42us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837408.570327:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:0.0:1788837408.570339:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:0.0:1788837408.570344:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:2361:x1875731688794624:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837408.570365:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:2361:x1875731688794624:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 22us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837408.570377:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:3.0:1788837408.613763:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708712832:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.613840:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837408.613890:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708713344:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.613917:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837408.613944:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837408.613950:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708713216:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.613974:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837408.614001:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708713088:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837408.614051:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788837408.614057:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708712960:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614078:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837408.614094:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708713472:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614115:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837408.614142:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708713344 00000100:00100000:3.0:1788837408.614148:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708713344 00000100:00100000:3.0:1788837408.614195:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708713088 00000100:00100000:3.0:1788837408.614199:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708713088 00000100:00100000:3.0:1788837408.614219:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708712960 00000100:00100000:3.0:1788837408.614222:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708712960 00000100:00100000:3.0:1788837408.614237:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788837408.614245:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708713344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614297:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875731708713344:12345-0@lo:400:kworker.0 Request processed in 51us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.614332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788837408.614349:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788837408.614354:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708713088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614397:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708713088:12345-0@lo:400:kworker.0 Request processed in 42us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.614403:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788837408.614416:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788837408.614422:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708712960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614447:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708712960:12345-0@lo:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.614452:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788837408.614469:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708713216 00000100:00100000:3.0:1788837408.614472:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708713216 00000100:00100000:3.0:1788837408.614579:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708713472 00000100:00100000:3.0:1788837408.614582:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708713472 00000100:00100000:3.0:1788837408.614604:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788837408.614611:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708713216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614643:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708713216:12345-0@lo:400:kworker.0 Request processed in 34us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.614649:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788837408.614660:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788837408.614665:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708713472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614690:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708713472:12345-0@lo:400:kworker.0 Request processed in 26us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.614696:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788837408.614711:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837408.614715:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837408.614717:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837408.614752:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708712960:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614773:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788837408.614778:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788837408.614799:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708713472:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614809:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708713088:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614845:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708713216:0@lo:400:kworker.0 00000100:00100000:3.0:1788837408.614854:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1875731708713344:0@lo:400:kworker.0 00000100:00100000:0.0:1788837408.614941:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708712832 00000100:00100000:0.0:1788837408.614946:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708712832 00000100:00100000:0.0:1788837408.614974:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788837408.614981:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708712832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837408.615029:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb50786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3316:x1875731708712832:12345-0@lo:400:kworker.0 Request processed in 48us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837408.615035:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788837408.615808:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708712832:0@lo:400:kworker.0 00000004:00080000:1.0:1788837408.619400:0:8101:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362470093574ns, next at 363470091626ns, rc = 0 00000100:00100000:0.0:1788837408.619569:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708713600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837408.619635:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837408.619729:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708713600 00000100:00100000:1.0:1788837408.619736:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708713600 00000100:00100000:1.0:1788837408.619822:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788837408.619832:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708713600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837408.619864:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837408.619922:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708713600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837408.619930:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788837408.627582:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb457a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708713600:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788837408.681156:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837408.681165:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837408.681221:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788837408.681229:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837408.681367:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb797ab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708713728:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837408.681466:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837408.696110:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb797ab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708713728:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837408.701839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000001:00080000:2.0:1788837408.704728:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:2.0:1788837408.704766:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:2.0:1788837408.704808:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1788837408.704827:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788837408.704853:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9acb63528180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788837408.704859:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb46831c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9acb501109c0 00000020:00080000:2.0:1788837408.704862:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb46831100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9acb46953400 00000020:00080000:3.0:1788837408.705052:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788837408.705212:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788837408.705222:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837408.705241:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708713856:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788837408.705332:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837408.705377:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708713856 00000100:00100000:3.0:1788837408.705384:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708713856 00000100:00100000:3.0:1788837408.705425:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837408.705434:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708713856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788837408.705460:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788837408.705656:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f7e1e, atime: 0x6a9f7e1e, ctime: 0x6a9f7e1e, blocks: 0xb 00010000:00010000:3.0:1788837408.705666:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.705682:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1788837408.705687:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837408.705708:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.705723:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.705733:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.705741:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.705759:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837408.707446:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1875731708713856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2008us (2136us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788837408.707458:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788837408.707504:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837408.707511:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.707522:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837408.707527:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837408.707808:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb44fa1f80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788837408.707815:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708713856:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788837408.708167:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.708200:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.708208:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084bd8084/0x843cbef8be305f72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.708226:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837408.708228:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837408.708230:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837408.709001:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688795136 00000100:00100000:0.0:1788837408.709020:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688795136 00000100:00100000:2.0:1788837408.715348:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:2.0:1788837408.715362:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:11543:x1875731688795136:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788837408.716185:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788837408.716336:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:11543:x1875731688795136:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 974us (14501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837408.716346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:3.0:1788837408.731840:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.731874:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688795264 00000100:00100000:3.0:1788837408.731884:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688795264 00000100:00100000:3.0:1788837408.731944:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:3.0:1788837408.731955:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:11543:x1875731688795264:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788837408.732031:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732048:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732058:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732071:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732077:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732214:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732242:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732250:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732256:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837408.732290:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788837408.732295:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837408.732331:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732343:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732350:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732356:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732362:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837408.732366:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732373:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732462:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:3.0:1788837408.732465:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837408.732469:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732476:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be305f79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732489:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732495:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732500:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732505:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837408.732508:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732513:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732521:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9acb4556df00) 00010000:00010000:3.0:1788837408.732523:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837408.732526:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732542:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be305f80 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732567:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732573:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732578:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732584:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837408.732587:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732593:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732601:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ce100) 00010000:00010000:3.0:1788837408.732603:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837408.732606:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.732612:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be305f87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837408.732680:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:11543:x1875731688795264:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 726us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.732688:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:0.0:1788837408.739395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.739470:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688795520 00000100:00100000:3.0:1788837408.739479:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688795520 00000100:00100000:3.0:1788837408.739544:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:3.0:1788837408.739562:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+16:11543:x1875731688795520:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837408.739582:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837408.739600:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be305f8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd02 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.739690:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.739705:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.739714:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837408.739724:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788837408.739894:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.739901:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.741168:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.741184:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837408.741189:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.741197:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.741211:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ce100) 00010000:00010000:3.0:1788837408.741226:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837408.741230:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.741237:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.741292:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be305f8e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd02 expref: 18 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.741316:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:3.0:1788837408.741319:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837408.741323:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be305f8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd02 expref: 18 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.741334:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236c00, rc 0) 00000100:00100000:3.0:1788837408.741398:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:11543:x1875731688795520:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1838us (2314us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788837408.741406:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:3.0:1788837408.746619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837408.748043:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688795648 00000100:00100000:0.0:1788837408.748056:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688795648 00000100:00100000:0.0:1788837408.748128:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:0.0:1788837408.748138:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:11543:x1875731688795648:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788837408.748171:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788837408.748301:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:11543:x1875731688795648:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 163us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837408.748334:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:3.0:1788837408.757600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837408.757780:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688795904 00000100:00100000:1.0:1788837408.757790:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688795904 00000100:00100000:1.0:1788837408.757842:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:1.0:1788837408.757852:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:11543:x1875731688795904:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837408.757872:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837408.757875:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788837408.757901:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305f48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcf4 expref: 17 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.757931:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:1.0:1788837408.757937:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837408.757951:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be305fa3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd09 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837408.758699:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788837408.758947:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305faa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.758962:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.758972:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.759041:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be305fa3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd09 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.759058:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd09 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.759079:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb461b5a00) 00010000:00010000:1.0:1788837408.759082:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837408.759085:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576c00, rc 0) 00000100:00100000:1.0:1788837408.759144:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11543:x1875731688795904:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1293us (1553us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788837408.759152:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:1.0:1788837408.784496:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837408.784551:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688796160 00000100:00100000:1.0:1788837408.784560:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688796160 00000100:00100000:1.0:1788837408.784608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 176 00000100:00100000:1.0:1788837408.784618:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11543:x1875731688796160:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788837408.784673:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837408.784698:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be305faa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd09 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.784715:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb461b5a00) 00010000:00010000:1.0:1788837408.784725:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837408.784745:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.784757:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.784766:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.784779:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.784793:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.784800:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785014:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785023:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785029:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785036:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837408.785040:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785047:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785056:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:1.0:1788837408.785059:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837408.785063:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785068:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be305fb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785076:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785096:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785104:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785109:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837408.785112:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785119:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785126:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5335e0b4 (ffff9acb461b5100) 00010000:00010000:1.0:1788837408.785129:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837408.785132:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.785138:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5335e0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837408.794707:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:11543:x1875731688796160:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 10079us (10210us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837408.794720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 176 00000100:00100000:3.0:1788837408.798376:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837408.800323:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688796288 00000100:00100000:2.0:1788837408.800336:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688796288 00000100:00100000:2.0:1788837408.800606:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 177 00000100:00100000:2.0:1788837408.800620:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:11543:x1875731688796288:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837408.800640:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837408.800661:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305fc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd10 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837408.800715:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837408.800728:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837408.800738:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.801348:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be305fc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd10 expref: 19 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.801368:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd10 expref: 18 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.801376:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:3.0:1788837408.801669:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837408.801673:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542c00, rc 0) 00000100:00100000:3.0:1788837408.801745:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11543:x1875731688796288:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1128us (3375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.801753:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 177 00000100:00100000:3.0:1788837408.805937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837408.810256:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688796544 00000100:00100000:0.0:1788837408.810270:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688796544 00000100:00100000:0.0:1788837408.810365:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 178 00000100:00100000:0.0:1788837408.810387:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11543:x1875731688796544:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837408.810471:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.810490:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.810502:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837408.810768:0:11703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788837408.810779:0:11703:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362661474090ns, next at 363661471548ns, rc = 0 00000004:00010000:0.0:1788837408.810868:0:11703:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c344245 reply state 0000000038013991 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837408.810878:0:11703:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837408.810979:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:11543:x1875731688796544:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 604us (5049us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788837408.810987:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 178 00010000:00010000:3.0:1788837408.821494:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.821512:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.821520:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.821526:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917bc00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837408.821531:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.821539:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.821557:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:3.0:1788837408.821560:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788837408.821564:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.821570:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be305fd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837408.821733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837408.822748:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688796672 00000100:00100000:1.0:1788837408.822760:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688796672 00000100:00100000:1.0:1788837408.823122:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 179 00000100:00100000:1.0:1788837408.823135:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:11543:x1875731688796672:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837408.823158:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837408.823182:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd17 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.823346:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd17 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837408.823360:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd17 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.823780:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:0.0:1788837408.823784:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837408.823788:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576600, rc 0) 00000100:00100000:0.0:1788837408.823863:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:11543:x1875731688796672:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 730us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837408.834264:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.834336:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688796800 00000100:00100000:3.0:1788837408.834352:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688796800 00000100:00100000:3.0:1788837408.834408:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1788837408.834418:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2361:x1875731688796800:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788837408.834782:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 179 00000100:00100000:3.0:1788837408.835522:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688796800:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 1101us (1262us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788837408.835532:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1788837408.847182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.847406:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688797056 00000100:00100000:3.0:1788837408.847416:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688797056 00000100:00100000:3.0:1788837408.847466:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:3.0:1788837408.847476:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:11543:x1875731688797056:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788837408.847729:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:11543:x1875731688797056:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 253us (555us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788837408.847737:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:3.0:1788837408.855490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837408.856099:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688797312 00000100:00100000:0.0:1788837408.856109:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688797312 00000100:00100000:0.0:1788837408.856180:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 180 00000100:00100000:0.0:1788837408.856199:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:11543:x1875731688797312:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837408.856338:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:11543:x1875731688797312:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 142us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837408.856345:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 180 00000100:00100000:1.0:1788837408.861909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837408.861996:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688797440 00000100:00100000:0.0:1788837408.862015:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688797440 00000100:00100000:0.0:1788837408.862074:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 181 00000100:00100000:0.0:1788837408.862085:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:11543:x1875731688797440:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837408.862114:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837408.862134:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305fe2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd1e expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.862227:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.862241:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.862252:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837408.862284:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837408.862348:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.862374:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be305fe2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd1e expref: 23 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.862400:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd1e expref: 22 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.862408:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:0.0:1788837408.862411:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788837408.862414:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917a400, rc 0) 00000100:00100000:0.0:1788837408.862466:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:11543:x1875731688797440:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 384us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837408.862473:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 181 00000100:00100000:1.0:1788837408.874396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.874632:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688797568 00000100:00100000:3.0:1788837408.874642:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688797568 00000100:00100000:3.0:1788837408.874700:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:3.0:1788837408.874710:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688797568:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837408.874727:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837408.874746:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd25 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837408.874771:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7e21, blocks: 0x1 00010000:00010000:3.0:1788837408.874788:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1788837408.874793:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837408.874801:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd25 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.874827:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd25 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.874841:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237600, rc 0) 00000100:00100000:3.0:1788837408.874916:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2361:x1875731688797568:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 198us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.874924:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:1.0:1788837408.878984:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837408.879130:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688797824 00000100:00100000:0.0:1788837408.879140:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688797824 00000100:00100000:3.0:1788837408.879352:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:3.0:1788837408.879365:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:11543:x1875731688797824:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788837408.879470:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:11543:x1875731688797824:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 108us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.879478:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:0.0:1788837408.894936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.895051:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688797952 00000100:00100000:3.0:1788837408.895060:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688797952 00000100:00100000:3.0:1788837408.895119:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:3.0:1788837408.895129:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb797a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:11543:x1875731688797952:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837408.895144:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837408.895160:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd2c expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.895198:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd25 expref: 9 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.895220:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837408.895223:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837408.895229:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.895259:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd25 expref: 9 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.895276:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd25 expref: 9 pid: 6701 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837408.895289:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708713984:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837408.895396:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837408.908270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837408.908393:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688798080 00000100:00100000:0.0:1788837408.908402:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688798080 00010000:00010000:0.0:1788837408.908441:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd25 expref: 10 pid: 6701 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837408.908479:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:0.0:1788837408.908489:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:2360:x1875731688798080:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837408.908502:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837408.908524:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd25 expref: 10 pid: 6701 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.908551:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd25 expref: 10 pid: 6701 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.908574:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837408.908579:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837408.908587:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.908597:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837408.908631:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837408.908644:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74eff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875731708714112:192.168.203.43@tcp:105: 00000100:00100000:0.0:1788837408.908723:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50f9c9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788837408.918140:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ac3c22b/0x843cbef8be305ff0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd25 expref: 10 pid: 6701 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837408.918164:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708713984:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837408.918210:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837408.918225:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236c00, rc 0) 00000100:00100000:3.0:1788837408.918450:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74eff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875731708714112:192.168.203.43@tcp:105: 00010000:00010000:3.0:1788837408.918463:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837408.918517:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688798080:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 10028us (10254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837408.918528:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:2.0:1788837408.918803:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb797a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:11543:x1875731688797952:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 23674us (23873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837408.918810:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:3.0:1788837408.925152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837408.925201:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688798208 00000100:00100000:3.0:1788837408.925210:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688798208 00002000:00100000:3.0:1788837408.925255:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9acb74e59180 x1875731688798208/t0(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:64/0 lens 504/0 e 0 to 0 dl 1788837419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837408.925266:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74e59180 with x1875731688798208 ext(0->8) 00002000:00010000:3.0:1788837408.925271:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb74e59180 00000100:00100000:3.0:1788837408.925299:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1788837408.925325:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688798208:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788837408.925863:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:2360:x1875731688798208:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 538us (717us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788837408.925872:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00002000:00100000:3.0:1788837408.925880:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9acb74e59180 x1875731688798208/t4294967314(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:64/0 lens 504/448 e 0 to 0 dl 1788837419 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837408.925889:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74e59180 with x1875731688798208 ext(0->8) 00002000:00010000:3.0:1788837408.925892:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb74e59180 00000100:00100000:3.0:1788837408.929656:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837408.930506:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688798336 00000100:00100000:2.0:1788837408.930517:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688798336 00000100:00100000:2.0:1788837408.930576:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 183 00000100:00100000:2.0:1788837408.930586:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:11543:x1875731688798336:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1788837408.961719:0:12517:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837408.961729:0:12517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837408.961779:0:12517:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788837408.961786:0:12517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788837409.013209:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:11543:x1875731688798336:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 82613us (83549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837409.013223:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 183 00000001:00080000:2.0:1788837409.013261:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788837409.013268:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1788837409.013297:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:2.0:1788837409.013335:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1788837409.013344:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788837409.013360:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788837409.013371:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788837409.016606:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708714240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788837409.016679:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837409.016754:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708714240 00000100:00100000:0.0:1788837409.016760:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708714240 00000100:00100000:0.0:1788837409.016803:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837409.016826:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708714240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788837409.016990:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788837409.016994:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788837409 00002000:00010000:0.0:1788837409.016996:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788837409.016998:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788837409 -> 1788837409 00002000:00010000:0.0:1788837409.017010:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788837409.017052:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1875731708714240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (372us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788837409.017059:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1788837409.017102:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb74eff480/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788837409.017107:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708714240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788837409.025091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837409.025245:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688798464 00000100:00100000:0.0:1788837409.025255:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688798464 00000100:00100000:0.0:1788837409.025320:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:0.0:1788837409.025331:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:2360:x1875731688798464:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788837409.074271:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:2360:x1875731688798464:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 48932us (49180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837409.074284:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000001:00080000:0.0:1788837409.074340:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1788837409.074353:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788837409.086496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837409.086529:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688798720 00000100:00100000:3.0:1788837409.086538:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688798720 00000100:00100000:3.0:1788837409.086593:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 184 00000100:00100000:3.0:1788837409.086604:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11543:x1875731688798720:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837409.086662:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837409.086944:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be305fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd1e expref: 18 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.086964:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:3.0:1788837409.086969:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837409.087011:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.087026:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.087036:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837409.087881:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a381454a reply state 0000000052a232e8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837409.087895:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837409.088072:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:11543:x1875731688798720:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1468us (1581us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788837409.088080:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 184 00000100:00080000:3.0:1788837409.088113:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788837409.090212:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.090235:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.090243:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.090249:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837409.090254:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.090263:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.090279:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:2.0:1788837409.090282:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837409.090286:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.090292:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237600/0x843cbef8be305ffe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837409.095535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837409.095601:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688798848 00000100:00100000:1.0:1788837409.095611:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688798848 00000100:00100000:1.0:1788837409.095662:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:1.0:1788837409.095673:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688798848:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788837409.095910:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788837409.095914:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788837409 -> 1788837408 00002000:00010000:1.0:1788837409.095917:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788837406 00002000:00010000:1.0:1788837409.095919:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788837409 -> 1788837408 00002000:00010000:1.0:1788837409.095922:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788837409.095976:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2361:x1875731688798848:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 304us (446us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788837409.095984:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:1.0:1788837409.102940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837409.103019:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688799104 00000100:00100000:3.0:1788837409.103029:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688799104 00000100:00100000:3.0:1788837409.103085:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 185 00000100:00100000:3.0:1788837409.103095:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11543:x1875731688799104:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788837409.103156:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.103178:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd10 expref: 18 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.103282:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.103339:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd10 expref: 18 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.103352:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd10 expref: 18 pid: 7291 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837409.103365:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708714368:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837409.103440:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837409.114703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837409.114986:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708714368:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837409.115027:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837409.116562:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688799232 00000100:00100000:0.0:1788837409.116572:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688799232 00010000:00010000:0.0:1788837409.116609:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd10 expref: 19 pid: 7291 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837409.116644:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:0.0:1788837409.116661:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:2361:x1875731688799232:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837409.116676:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837409.116683:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd10 expref: 19 pid: 7291 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.116784:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd10 expref: 19 pid: 7291 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.116808:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be305fcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd10 expref: 19 pid: 7291 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.116821:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:0.0:1788837409.116825:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.116835:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.116841:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.116863:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837409.116925:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:2361:x1875731688799232:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 265us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837409.116934:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00010000:00010000:3.0:1788837409.118084:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.118095:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.118123:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.118130:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.118144:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.118151:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837409.118154:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.118162:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.118174:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:3.0:1788837409.118177:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788837409.118181:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.119585:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306005 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837409.121220:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:11543:x1875731688799104:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 18116us (18278us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788837409.121234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 185 00000100:00100000:1.0:1788837409.123866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837409.124386:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688799360 00000100:00100000:0.0:1788837409.124396:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688799360 00000100:00100000:0.0:1788837409.124443:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:0.0:1788837409.124452:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688799360:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788837409.124501:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.124521:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.124529:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837409.124533:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837409.124538:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.124572:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.124587:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 8 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837409.124601:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708714496:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837409.124672:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f75180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837409.130292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837409.130343:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688799488 00000100:00100000:2.0:1788837409.130351:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688799488 00010000:00010000:2.0:1788837409.130384:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 9 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837409.130417:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:2.0:1788837409.130426:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2361:x1875731688799488:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837409.130452:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837409.130471:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 9 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.130484:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 9 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.130507:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837409.130512:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837409.130517:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.130527:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.130544:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837409.130593:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2361:x1875731688799488:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 168us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837409.130601:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00010000:00010000:3.0:1788837409.135075:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec08fb34/0x843cbef8be305ff7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd2c expref: 8 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837409.135097:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1875731708714496:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837409.135121:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.135144:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.135150:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.135368:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.135378:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.135386:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.135393:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a600 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837409.135397:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.135405:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.135423:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.135440:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be30600c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837409.135522:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688799360:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 11069us (11665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837409.135531:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:2.0:1788837409.151591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837409.151655:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688799744 00000100:00100000:3.0:1788837409.151665:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688799744 00000100:00100000:3.0:1788837409.151723:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 186 00000100:00100000:3.0:1788837409.151733:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+17:11543:x1875731688799744:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837409.151807:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.151825:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.151837:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.152044:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.152055:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd17 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.152064:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.152107:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd17 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.152119:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd17 expref: 18 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837409.152133:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708714624:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837409.152790:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca43268000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837409.156554:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837409.156604:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708714624:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837409.156634:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837409.156662:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688799872 00000100:00100000:0.0:1788837409.156667:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688799872 00010000:00010000:0.0:1788837409.156776:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd17 expref: 19 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837409.156807:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:0.0:1788837409.156817:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:2360:x1875731688799872:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837409.156831:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837409.156837:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd17 expref: 19 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.156849:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd17 expref: 19 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.156869:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be305fdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd17 expref: 19 pid: 5844 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.156883:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:0.0:1788837409.156888:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.156896:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.156903:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.156983:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837409.157040:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:2360:x1875731688799872:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 224us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837409.157047:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00010000:00010000:0.0:1788837409.157078:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.157084:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837409.157858:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788837409.159069:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788837409.159130:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788837409.160384:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875731708714752:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788837409.160444:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837409.160471:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f75840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837409.160490:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708714752 00000100:00100000:0.0:1788837409.160495:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708714752 00000100:00100000:0.0:1788837409.160535:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837409.160544:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875731708714752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788837409.160612:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875731708714752:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837409.160619:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837409.160653:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788837409.160657:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb74eff480, transno 4294967315 00000100:00100000:0.0:1788837409.160668:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875731708714752:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788837409.163510:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788837409.163600:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875731708714880:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788837409.163667:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837409.164127:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708714880 00000100:00100000:1.0:1788837409.164134:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708714880 00000100:00100000:1.0:1788837409.164176:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837409.164196:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875731708714880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788837409.165038:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f75cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837409.165449:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875731708714880:12345-0@lo:1000:mdt00_002.0 Request processed in 1262us (1780us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788837409.165459:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837409.165561:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7574d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875731708714880:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788837409.165597:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165620:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165627:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165633:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837409.165637:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165643:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165659:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb454ce300) 00010000:00010000:0.0:1788837409.165662:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837409.165666:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165672:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237000/0x843cbef8be30601a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165814:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165822:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165827:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165832:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837409.165841:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165848:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165857:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ce100) 00010000:00010000:0.0:1788837409.165860:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837409.165863:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.165869:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be305f4f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.166290:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.166782:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcfb expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.166794:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.167563:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcfb expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.167580:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcfb expref: 21 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837409.167594:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708715008:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837409.167664:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f75cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837409.171105:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708715008:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837409.171137:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837409.171652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837409.171713:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688800000 00000100:00100000:2.0:1788837409.171720:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688800000 00010000:00010000:2.0:1788837409.171753:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcfb expref: 22 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837409.171804:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:2.0:1788837409.171812:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:2361:x1875731688800000:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837409.171827:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837409.171833:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcfb expref: 22 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.171845:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcfb expref: 22 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.171867:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237800/0x843cbef8be305f6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbcfb expref: 22 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.171883:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ce100) 00010000:00010000:2.0:1788837409.171888:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.171898:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.171905:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837409.171938:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837409.171986:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:2361:x1875731688800000:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 174us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837409.171993:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00010000:00010000:0.0:1788837409.172110:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172118:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172128:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172134:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172140:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172144:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837409.172148:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172155:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172163:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ce100) 00010000:00010000:0.0:1788837409.172166:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837409.172169:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172175:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306021 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172194:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172207:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172222:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172228:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837409.172230:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172236:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172244:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb454ce100) 00010000:00010000:0.0:1788837409.172246:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788837409.172249:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837409.172254:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236000/0x843cbef8be306013 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837409.172468:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:11543:x1875731688799744:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 20735us (20882us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788837409.172475:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 186 00000020:00080000:0.0:1788837409.172479:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788837409.172726:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837409.172737:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837409.173557:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788837409.173567:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837409.176473:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837409.176744:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688800256 00000100:00100000:3.0:1788837409.176756:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688800256 00000100:00100000:3.0:1788837409.176809:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:3.0:1788837409.176820:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:11543:x1875731688800256:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788837409.177771:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788837409.177911:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788837409.177973:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.177997:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.178031:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.178040:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.178052:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.178067:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837409.178092:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837409.178219:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:11543:x1875731688800256:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 1399us (1752us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788837409.178228:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000020:00080000:3.0:1788837409.178233:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837409.178838:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837409.178845:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837409.178852:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237e00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837409.178855:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837409.178863:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837409.178877:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9acb4556df00) 00010000:00010000:1.0:1788837409.178880:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788837409.178884:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837409.178890:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237e00/0x843cbef8be306028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837409.178911:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837409.178912:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837409.178914:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837409.509515:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837410.536516:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837410.661437:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837410.661458:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7904b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708715136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837410.661522:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837410.661583:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708715136 00000100:00100000:2.0:1788837410.661590:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708715136 00000100:00100000:2.0:1788837410.661641:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788837410.661651:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875731708715136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837410.661684:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837410.661726:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875731708715136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837410.661732:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788837410.661752:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837410.661785:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7904b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708715136:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788837410.776922:0:12571:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837410.776930:0:12571:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837410.776961:0:12571:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788837410.776965:0:12571:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837410.928383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837410.928425:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688800512 00000100:00100000:1.0:1788837410.928433:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688800512 00000100:00100000:1.0:1788837410.928484:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 187 00000100:00100000:1.0:1788837410.928494:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:11561:x1875731688800512:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837410.928518:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837410.928537:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30602f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd33 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837410.928624:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be306036 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837410.928639:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be306036 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837410.928650:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be306036 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837410.928661:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788837410.928907:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30602f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd33 expref: 25 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837410.928925:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be306036 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd33 expref: 24 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837410.928933:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:1.0:1788837410.928936:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837410.928940:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576e00, rc 0) 00000100:00100000:1.0:1788837410.929007:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:11561:x1875731688800512:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 514us (631us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788837410.929022:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 187 00000100:00100000:2.0:1788837410.937041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837410.938167:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688800640 00000100:00100000:0.0:1788837410.938181:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688800640 00000100:00100000:0.0:1788837410.938234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 188 00000100:00100000:0.0:1788837410.938243:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:11561:x1875731688800640:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1788837410.938329:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938346:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938356:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938370:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938378:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938384:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938576:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938584:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938590:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837410.938623:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938635:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938645:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938653:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938658:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ba00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837410.938663:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938671:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938682:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:0.0:1788837410.938685:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837410.938689:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938705:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938711:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938717:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938722:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837410.938729:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938735:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938742:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb50df5400) 00010000:00010000:0.0:1788837410.938744:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837410.938747:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.938753:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be30604b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.939120:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.939128:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.939133:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.939138:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917aa00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837410.939141:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.939147:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.939156:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:0.0:1788837410.939159:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837410.939169:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.939175:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306052 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837410.939299:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:11561:x1875731688800640:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1054us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837410.939323:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 188 00000100:00100000:1.0:1788837410.989724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837410.989811:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688800896 00000100:00100000:0.0:1788837410.989822:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688800896 00000100:00100000:0.0:1788837410.989889:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 189 00000100:00100000:0.0:1788837410.989910:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+24:11564:x1875731688800896:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837410.989928:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837410.989949:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306059 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd3a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990025:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990040:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990051:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990067:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990073:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990097:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990380:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990389:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990397:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837410.990406:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788837410.990502:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990510:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990516:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990522:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837410.990526:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990533:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990545:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:0.0:1788837410.990548:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837410.990560:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990567:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be306060 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990580:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990586:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990592:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990598:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ba00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837410.990600:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990607:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990614:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb50df5a00) 00010000:00010000:0.0:1788837410.990617:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837410.990620:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990625:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306067 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990663:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917aa00/0x843cbef8be306059 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd3a expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990689:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd3a expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837410.990696:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837410.990699:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837410.990701:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917b000, rc 0) 00000100:00100000:0.0:1788837410.990753:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:11564:x1875731688800896:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 855us (1037us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788837410.990760:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 189 00000100:00100000:2.0:1788837410.999082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837411.002145:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688801024 00000100:00100000:1.0:1788837411.002159:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688801024 00000100:00100000:1.0:1788837411.002352:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 190 00000100:00100000:1.0:1788837411.002363:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:11564:x1875731688801024:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:1.0:1788837411.002427:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.002445:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.002458:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.002482:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.002489:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.002496:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.002502:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837411.002507:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.002515:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.002543:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:1.0:1788837411.002546:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837411.002551:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.002558:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30607c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837411.002638:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:11564:x1875731688801024:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 276us (3564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837411.002644:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 190 00000100:00100000:3.0:1788837411.004804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.004889:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688801280 00000100:00100000:0.0:1788837411.004898:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688801280 00000100:00100000:0.0:1788837411.004949:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:0.0:1788837411.004958:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:11564:x1875731688801280:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1788837411.005173:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:11564:x1875731688801280:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 216us (376us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788837411.005181:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00080000:2.0:1788837411.006412:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837411.056039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837411.056134:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688801536 00000100:00100000:2.0:1788837411.056143:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688801536 00000100:00100000:2.0:1788837411.056195:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 191 00000100:00100000:2.0:1788837411.056205:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:11090:x1875731688801536:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1788837411.056228:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837411.056247:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be306083 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd41 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.056452:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.056478:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd3a expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.056488:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.056516:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd3a expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.056529:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd3a expref: 28 pid: 5846 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837411.056542:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79048a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875731708715264:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837411.056688:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb454809c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837411.065685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.065768:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688801664 00000100:00100000:0.0:1788837411.065778:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688801664 00010000:00010000:0.0:1788837411.065815:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd3a expref: 29 pid: 5846 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837411.065855:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:0.0:1788837411.065864:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74eff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:2360:x1875731688801664:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837411.065878:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837411.065897:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd3a expref: 29 pid: 5846 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.065910:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd3a expref: 29 pid: 5846 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.065931:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837411.065936:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.065945:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.065952:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.065969:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837411.066030:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74eff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:2360:x1875731688801664:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 166us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837411.066037:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00010000:00010000:2.0:1788837411.066555:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be30606e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd3a expref: 28 pid: 5846 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837411.066573:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79048a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875731708715264:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837411.066591:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.066599:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.066605:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837411.066622:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788837411.066757:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be306083 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd41 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.066772:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd41 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.066780:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:2.0:1788837411.066783:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837411.066785:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542800, rc 0) 00000100:00100000:2.0:1788837411.066869:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:11090:x1875731688801536:12345-192.168.203.43@tcp:101:bash.0 Request processed in 10665us (10841us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788837411.066877:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 191 00000100:00100000:1.0:1788837411.076393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837411.076556:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688801920 00000100:00100000:3.0:1788837411.076565:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688801920 00000100:00100000:3.0:1788837411.076618:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:3.0:1788837411.076628:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:11090:x1875731688801920:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:3.0:1788837411.076863:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.076879:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.076890:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837411.076945:0:7291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788837411.076967:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e11fd064 reply state 00000000b4d8c6dc transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837411.076976:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788837411.077034:0:7291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788837411.077139:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:11090:x1875731688801920:12345-192.168.203.43@tcp:36:bash.0 Request processed in 512us (754us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788837411.077147:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 192 00000020:00080000:3.0:1788837411.077151:0:7291:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788837411.084612:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.084630:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.084639:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.084645:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837411.084652:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.084671:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.084688:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837411.084691:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837411.084696:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.084702:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be306098 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837411.084812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837411.084903:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688802048 00000100:00100000:1.0:1788837411.084912:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688802048 00000100:00100000:1.0:1788837411.084957:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:1.0:1788837411.084966:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:11090:x1875731688802048:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1788837411.084995:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837411.085013:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30609f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd48 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.085060:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30609f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd48 expref: 32 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.085073:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30609f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd48 expref: 32 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.085101:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:1.0:1788837411.085104:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837411.085106:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577e00, rc 0) 00000100:00100000:1.0:1788837411.085161:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:11090:x1875731688802048:12345-192.168.203.43@tcp:101:bash.0 Request processed in 195us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837411.085168:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:3.0:1788837411.088200:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.088267:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688802176 00000100:00100000:0.0:1788837411.088276:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688802176 00000100:00100000:0.0:1788837411.088368:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1788837411.088378:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:11090:x1875731688802176:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837411.088392:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837411.088410:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd4f expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837411.088433:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f7e20, atime: 0x6a9f7e1e, ctime: 0x6a9f7e20, blocks: 0xb 00010000:00010000:0.0:1788837411.088453:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1788837411.088457:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837411.088465:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd4f expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.088479:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd4f expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.088509:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917aa00, rc 0) 00000100:00100000:0.0:1788837411.088555:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:11090:x1875731688802176:12345-192.168.203.43@tcp:101:bash.0 Request processed in 179us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837411.088561:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00080000:3.0:1788837411.089435:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837411.090635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.090727:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688802304 00000100:00100000:0.0:1788837411.090734:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688802304 00002000:00010000:0.0:1788837411.090765:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788837411.090769:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb79048a80 with x1875731688802304 ext(0->18446744073709551615) 00002000:00010000:0.0:1788837411.090779:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb79048a80. 00000100:00100000:0.0:1788837411.090806:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:0.0:1788837411.090815:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688802304:12345-192.168.203.43@tcp:10:bash.0 00002000:00010000:0.0:1788837411.091162:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788837411.091166:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788837408 -> 1788837412 00002000:00010000:0.0:1788837411.091169:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788837406 -> 1788837406 00002000:00010000:0.0:1788837411.091170:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788837408 -> 1788837412 00002000:00010000:0.0:1788837411.091172:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788837411.091266:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688802304:12345-192.168.203.43@tcp:10:bash.0 Request processed in 452us (636us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788837411.091274:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00002000:00010000:0.0:1788837411.091277:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788837411.091279:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb79048a80 with x1875731688802304 ext(0->18446744073709551615) 00002000:00010000:0.0:1788837411.091284:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb79048a80. 00000100:00100000:0.0:1788837411.177097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837411.177403:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688802432 00000100:00100000:2.0:1788837411.177412:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688802432 00000100:00100000:2.0:1788837411.177467:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:2.0:1788837411.177476:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:11578:x1875731688802432:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:2.0:1788837411.177538:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177553:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177565:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177578:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177584:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177602:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177810:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177819:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177827:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837411.177860:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177871:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177877:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177883:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177889:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837411.177905:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177914:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177925:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:2.0:1788837411.177934:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837411.177939:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177945:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543e00/0x843cbef8be3060ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177958:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177964:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177970:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177975:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837411.177978:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.177984:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.178005:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb454cef00) 00010000:00010000:2.0:1788837411.178008:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837411.178011:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.178017:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be3060b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.178030:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.178041:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.178047:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.178052:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837411.178056:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.178062:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.178070:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:2.0:1788837411.178073:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837411.178076:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.178081:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543800/0x843cbef8be3060bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837411.178205:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:11578:x1875731688802432:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 730us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837411.178213:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:3.0:1788837411.221293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.221359:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688802688 00000100:00100000:0.0:1788837411.221381:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688802688 00000100:00100000:0.0:1788837411.221427:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00100000:0.0:1788837411.221436:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb795b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+32:11581:x1875731688802688:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837411.221455:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837411.221472:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221536:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221549:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221560:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221573:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221580:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221585:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221815:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3060d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221825:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3060d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221832:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3060d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837411.221846:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788837411.221928:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221936:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221943:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221949:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837411.221953:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221960:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221971:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:0.0:1788837411.221975:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837411.221979:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.221998:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3060c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222010:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222016:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222032:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222037:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837411.222040:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222046:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222054:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb50df5600) 00010000:00010000:0.0:1788837411.222056:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837411.222059:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222064:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be3060d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222101:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd56 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222114:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3060d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd56 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.222120:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837411.222122:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788837411.222125:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917ac00, rc 0) 00000100:00100000:0.0:1788837411.222187:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb795b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:11581:x1875731688802688:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 751us (902us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788837411.222204:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00100000:1.0:1788837411.232397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.232478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688802816 00000100:00100000:0.0:1788837411.232487:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688802816 00000100:00100000:0.0:1788837411.232541:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:0.0:1788837411.232550:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:11581:x1875731688802816:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:0.0:1788837411.232611:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.232626:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd41 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.232635:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.232663:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd41 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.232676:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd41 expref: 34 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837411.232689:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb741ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708715392:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837411.232801:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f75000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837411.237194:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb741ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875731708715392:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837411.237222:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837411.237540:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.237633:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688803072 00000100:00100000:0.0:1788837411.237647:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688803072 00000100:00100000:0.0:1788837411.237692:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:0.0:1788837411.237702:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:5595:x1875731688803072:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788837411.238904:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:5595:x1875731688803072:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 1192us (1354us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788837411.238914:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:3.0:1788837411.242723:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837411.243237:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688803200 00000100:00100000:2.0:1788837411.243247:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688803200 00010000:00010000:2.0:1788837411.243286:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd41 expref: 36 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837411.243379:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:2.0:1788837411.243390:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7574f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:2360:x1875731688803200:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837411.243405:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837411.243413:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd41 expref: 36 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.243426:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd41 expref: 36 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.243448:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30608a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd41 expref: 36 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.243464:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:2.0:1788837411.243470:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.243480:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.243487:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.243520:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837411.243580:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7574f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:2360:x1875731688803200:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 192us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837411.243588:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00010000:00010000:0.0:1788837411.243703:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.243711:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.243741:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.243748:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.243755:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.243761:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837411.243766:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.243773:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.243795:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837411.243798:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837411.243809:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.243815:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b400/0x843cbef8be3060e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837411.243854:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:11581:x1875731688802816:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 11305us (11465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837411.244082:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:1.0:1788837411.251701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837411.251794:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688803456 00000100:00100000:3.0:1788837411.251805:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688803456 00000100:00100000:3.0:1788837411.251868:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:3.0:1788837411.251878:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+34:11581:x1875731688803456:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1788837411.252450:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:11581:x1875731688803456:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 573us (757us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788837411.252458:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:1.0:1788837411.353133:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837411.353287:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688803712 00000100:00100000:3.0:1788837411.353297:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688803712 00000100:00100000:3.0:1788837411.353416:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 197 00000100:00100000:3.0:1788837411.353427:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+35:11592:x1875731688803712:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1788837411.353450:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837411.353470:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3060ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd5d expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353538:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353552:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353575:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353591:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353598:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353605:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353847:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353857:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353864:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837411.353873:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788837411.353956:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353963:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353971:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.353976:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837411.353998:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354007:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354018:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837411.354021:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837411.354027:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354034:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3060f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354048:0:7291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354054:0:7291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354060:0:7291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354065:0:7291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837411.354068:0:7291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354074:0:7291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354082:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb4556de00) 00010000:00010000:3.0:1788837411.354084:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837411.354095:0:7291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354100:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3060fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354142:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3060ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd5d expref: 38 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354156:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd5d expref: 37 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.354163:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:3.0:1788837411.354166:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837411.354181:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237c00, rc 0) 00000100:00100000:3.0:1788837411.354563:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:11592:x1875731688803712:12345-192.168.203.43@tcp:101:cat.0 Request processed in 1136us (1437us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788837411.354572:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 197 00000100:00100000:0.0:1788837411.361128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837411.361208:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688803968 00000100:00100000:3.0:1788837411.361217:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688803968 00000100:00100000:3.0:1788837411.361270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1788837411.361281:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:11592:x1875731688803968:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:3.0:1788837411.361534:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:11592:x1875731688803968:12345-192.168.203.43@tcp:35:cat.0 Request processed in 254us (413us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788837411.361541:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:2.0:1788837411.389808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.389931:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688804224 00000100:00100000:0.0:1788837411.389941:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688804224 00000100:00100000:0.0:1788837411.390080:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00100000:0.0:1788837411.390093:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:11593:x1875731688804224:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:0.0:1788837411.390145:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788837411.390183:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd5d expref: 38 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390207:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be3060d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd56 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390222:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30609f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd48 expref: 36 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390233:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5400) 00010000:00010000:0.0:1788837411.390243:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837411.390264:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390288:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390298:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390360:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390368:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390376:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390615:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390624:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.390631:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837411.391266:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788837411.391277:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365241972208ns, next at 366241969831ns, rc = 0 00010000:00010000:0.0:1788837411.391377:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391390:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391411:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391419:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391426:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391433:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391667:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837411.391687:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391694:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391701:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391706:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ae00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837411.391711:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391719:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391731:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5200) 00010000:00010000:0.0:1788837411.391734:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788837411.391747:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391753:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be30611d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391770:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391777:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391783:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391788:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837411.391790:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391796:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391804:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:0.0:1788837411.391807:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837411.391810:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.391816:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30610f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837411.391825:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064ca33e0 reply state 000000008d5d1f95 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837411.391844:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837411.392209:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+37:11593:x1875731688804224:12345-192.168.203.43@tcp:36:rm.0 Request processed in 2116us (2408us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788837411.392218:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 198 00010000:00010000:3.0:1788837411.393163:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837411.393389:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.393414:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837411.393419:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.393427:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.393442:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9acb50df5200) 00010000:00010000:3.0:1788837411.393444:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788837411.393449:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.393454:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a400/0x843cbef8be306124 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.393476:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837411.393478:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837411.393480:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837411.395067:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.395082:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.395089:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.395095:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837411.395099:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.395106:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.395121:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb50df5600) 00010000:00010000:1.0:1788837411.395124:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837411.395128:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.395147:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be306116 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837411.466792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.467545:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688804480 00000100:00100000:0.0:1788837411.467555:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688804480 00000100:00100000:0.0:1788837411.467611:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 199 00000100:00100000:0.0:1788837411.467620:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+36:11599:x1875731688804480:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837411.467642:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837411.467661:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30612b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd64 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.467806:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.467821:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.467831:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.467845:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.467852:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.467868:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837411.468514:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788837411.468652:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468664:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468672:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468700:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468708:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468715:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468721:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ae00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837411.468725:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468732:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468743:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:0.0:1788837411.468746:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837411.468749:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468766:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ae00/0x843cbef8be306132 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837411.468779:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5925784 reply state 00000000e1c678a5 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837411.468789:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788837411.468813:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be30612b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd64 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468826:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd64 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.468834:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb50df5d00) 00010000:00010000:0.0:1788837411.468837:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837411.468839:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917bc00, rc 0) 00000100:00100000:0.0:1788837411.470936:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+39:11599:x1875731688804480:12345-192.168.203.43@tcp:101:bash.0 Request processed in 3308us (4144us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788837411.470948:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 199 00010000:00010000:0.0:1788837411.475638:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.475655:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.475663:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.475669:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ac00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837411.475688:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.475696:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.475712:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb50df5400) 00010000:00010000:0.0:1788837411.475715:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837411.475719:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.475725:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be306139 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837411.478590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837411.478829:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688804608 00000100:00100000:1.0:1788837411.478840:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688804608 00000100:00100000:1.0:1788837411.478918:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:1.0:1788837411.478931:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688804608:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1788837411.478950:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837411.478969:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd6b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837411.479007:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788837411.479025:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1788837411.479030:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837411.479040:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd6b expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.479056:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd6b expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.479069:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577600, rc 0) 00000100:00100000:1.0:1788837411.479131:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688804608:12345-192.168.203.43@tcp:101:bash.0 Request processed in 204us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837411.479137:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00080000:3.0:1788837411.483207:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837411.487298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.489172:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688804736 00000100:00100000:0.0:1788837411.489188:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688804736 00000100:00100000:1.0:1788837411.492080:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1788837411.492095:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:11599:x1875731688804736:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1788837411.492127:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837411.492146:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd72 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.492178:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd6b expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.492188:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837411.492193:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837411.492198:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.492235:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd6b expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.492248:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd6b expref: 7 pid: 6700 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837411.492263:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1875731708715520:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837411.492406:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb63528180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837411.497192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.497347:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688804864 00000100:00100000:0.0:1788837411.497358:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688804864 00010000:00010000:0.0:1788837411.497399:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd6b expref: 8 pid: 6700 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837411.497450:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:0.0:1788837411.497460:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688804864:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837411.497477:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837411.497500:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd6b expref: 8 pid: 6700 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.497512:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd6b expref: 8 pid: 6700 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.497556:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837411.497561:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837411.497570:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.497580:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.497616:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837411.497630:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875731708715648:192.168.203.43@tcp:105: 00000100:00100000:0.0:1788837411.497712:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44f75900 going to sleep for 11 seconds 00010000:00010000:2.0:1788837411.498088:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b83e2c4a/0x843cbef8be30614e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd6b expref: 8 pid: 6700 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837411.498105:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1875731708715520:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837411.498191:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.498203:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577000, rc 0) 00000100:00100000:2.0:1788837411.498246:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:11599:x1875731688804736:12345-192.168.203.43@tcp:101:bash.0 Request processed in 6155us (10959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837411.498254:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1788837411.502450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.502564:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875731708715648:192.168.203.43@tcp:105: 00010000:00010000:0.0:1788837411.502590:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837411.502655:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2360:x1875731688804864:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 5196us (5472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837411.502666:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:3.0:1788837411.502744:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688805120 00000100:00100000:3.0:1788837411.502752:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688805120 00000100:00100000:3.0:1788837411.502794:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1788837411.502803:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+38:11599:x1875731688805120:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:3.0:1788837411.503139:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+39:11599:x1875731688805120:12345-192.168.203.43@tcp:35:bash.0 Request processed in 335us (695us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788837411.503147:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00010000:00010000:1.0:1788837411.557600:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837411.646188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837411.646242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837411.646372:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688805376 00000100:00100000:0.0:1788837411.646383:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688805376 00000100:00100000:0.0:1788837411.646438:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:0.0:1788837411.646448:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb457a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688805376:12345-192.168.203.43@tcp:16:kworker.0 00000100:00100000:0.0:1788837411.646568:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb457a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688805376:12345-192.168.203.43@tcp:16:kworker.0 Request processed in 121us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837411.646585:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1788837411.646715:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688805248 00000100:00100000:1.0:1788837411.646720:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688805248 00002000:00100000:1.0:1788837411.646751:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9acb74e5ed80 x1875731688805248/t0(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:67/0 lens 504/0 e 0 to 0 dl 1788837422 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837411.646773:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74e5ed80 with x1875731688805248 ext(0->8) 00002000:00010000:1.0:1788837411.646778:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9acb74e5ed80 00000100:00100000:1.0:1788837411.646807:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1788837411.646815:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+6:2359:x1875731688805248:12345-192.168.203.43@tcp:4:bash.0 00000100:00100000:1.0:1788837411.647269:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2359:x1875731688805248:12345-192.168.203.43@tcp:4:bash.0 Request processed in 454us (1101us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788837411.647276:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00002000:00100000:1.0:1788837411.647283:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9acb74e5ed80 x1875731688805248/t4294967308(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:67/0 lens 504/448 e 0 to 0 dl 1788837422 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837411.647292:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74e5ed80 with x1875731688805248 ext(0->8) 00002000:00010000:1.0:1788837411.647295:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9acb74e5ed80 00000100:00100000:3.0:1788837411.717460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837411.717559:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688805504 00000100:00100000:1.0:1788837411.717569:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688805504 00000100:00100000:1.0:1788837411.717620:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 200 00000100:00100000:1.0:1788837411.717628:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+39:11615:x1875731688805504:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837411.717648:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837411.717666:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30615c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd79 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.717727:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be306163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.717740:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be306163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.717763:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be306163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837411.717796:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788837411.717800:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837411.717816:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be306163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.717840:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30615c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd79 expref: 41 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.717868:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be306163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd79 expref: 40 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.717877:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:1.0:1788837411.717880:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837411.717884:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577c00, rc 0) 00000100:00100000:1.0:1788837411.717944:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:11615:x1875731688805504:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 315us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837411.717951:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 200 00000100:00100000:3.0:1788837411.721696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837411.721785:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688805760 00000100:00100000:1.0:1788837411.721795:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688805760 00000100:00100000:1.0:1788837411.721852:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:1.0:1788837411.721872:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+40:11615:x1875731688805760:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837411.721901:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837411.721922:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30616a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.722050:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be306171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.722064:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be306171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.722074:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be306171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837411.722085:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788837411.722213:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30616a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd80 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.722231:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be306171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd80 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.722253:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb50df5d00) 00010000:00010000:1.0:1788837411.722256:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837411.722259:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577e00, rc 0) 00000100:00100000:1.0:1788837411.722344:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+42:11615:x1875731688805760:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 474us (657us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788837411.722352:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:3.0:1788837411.728064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837411.728163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837411.728431:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688806144 00000100:00100000:1.0:1788837411.728440:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688806144 00000100:00100000:1.0:1788837411.728494:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1788837411.728504:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+42:2361:x1875731688806144:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837411.728519:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837411.728558:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be306171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd80 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.728578:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb50df5d00) 00010000:00010000:1.0:1788837411.728583:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837411.728636:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:2361:x1875731688806144:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 133us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837411.728644:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1788837411.731638:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688806016 00000100:00100000:0.0:1788837411.731652:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688806016 00000100:00100000:0.0:1788837411.731717:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:0.0:1788837411.731728:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+41:11615:x1875731688806016:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837411.731754:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837411.731776:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30617f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd87 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.732062:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306186 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.732080:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.732092:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837411.732107:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788837411.732248:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ac00/0x843cbef8be30617f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd87 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.732265:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd87 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837411.732273:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb50df5d00) 00010000:00010000:0.0:1788837411.732276:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788837411.732280:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917a600, rc 0) 00000100:00100000:0.0:1788837411.732422:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+43:11615:x1875731688806016:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 695us (4366us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788837411.732430:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:3.0:1788837411.742191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837411.742231:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688806272 00000100:00100000:3.0:1788837411.742240:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688806272 00000100:00100000:3.0:1788837411.742288:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1788837411.742298:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688806272:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:3.0:1788837411.742367:0:8306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.742388:0:8306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.742397:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837411.742401:0:8306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837411.742406:0:8306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.742440:0:8306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.742455:0:8306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 8 pid: 6701 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837411.742468:0:8306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8306:1875731708715776:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837411.742568:0:8306:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fbaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837411.747704:0:8306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8306:1875731708715776:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837411.747705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:2.0:1788837411.747739:0:8306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837411.747829:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688806400 00000100:00100000:1.0:1788837411.747836:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688806400 00010000:00010000:1.0:1788837411.747867:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 9 pid: 6701 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837411.747895:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:1.0:1788837411.747903:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688806400:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837411.747917:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788837411.747933:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788837411.747936:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788837412 00002000:00010000:1.0:1788837411.747938:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788837412 00002000:00010000:1.0:1788837411.747941:0:5830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788837411.747946:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 9 pid: 6701 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.747958:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 9 pid: 6701 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.747979:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d461ec6f/0x843cbef8be306155 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd72 expref: 9 pid: 6701 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.748016:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837411.748021:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837411.748027:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.748037:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.748066:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837411.748158:0:8306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.748169:0:8306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.748195:0:8306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.748213:0:8306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.748222:0:8306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.748229:0:8306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236a00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837411.748234:0:8306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.748243:0:8306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.748257:0:8306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.748264:0:8306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4d1c763/0x843cbef8be306194 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837411.748363:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688806272:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 6065us (6180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837411.748373:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1788837411.748508:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688806400:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 604us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837411.748515:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:1.0:1788837411.753876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837411.753978:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688806656 00000100:00100000:3.0:1788837411.754000:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688806656 00000100:00100000:3.0:1788837411.754064:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:3.0:1788837411.754076:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+43:11615:x1875731688806656:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:3.0:1788837411.754136:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd87 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837411.754411:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788837411.754473:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788837411.754766:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788837411.754821:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.754838:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd64 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.754848:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.754898:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd64 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.754912:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd64 expref: 47 pid: 5846 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837411.754926:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e37800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875731708715904:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837411.755029:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837411.762011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837411.762052:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e37800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875731708715904:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837411.762053:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688806784 00010000:00010000:2.0:1788837411.762080:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837411.762459:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688806784 00010000:00010000:3.0:1788837411.762493:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd64 expref: 48 pid: 5846 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837411.762536:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:3.0:1788837411.762546:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+48:2360:x1875731688806784:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837411.762562:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837411.762569:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd64 expref: 48 pid: 5846 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.762582:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd64 expref: 48 pid: 5846 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.762604:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917bc00/0x843cbef8be306140 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd64 expref: 48 pid: 5846 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.762618:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb50df5d00) 00010000:00010000:3.0:1788837411.762622:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.762632:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.762640:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.762679:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837411.762729:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+47:2360:x1875731688806784:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 183us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837411.762746:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00010000:00010000:2.0:1788837411.762886:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837411.762896:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837411.763020:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788837411.763208:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788837411.763346:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75810e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708716032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788837411.763398:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837411.763432:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d2a4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837411.763436:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708716032 00000100:00100000:1.0:1788837411.763442:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708716032 00000100:00080000:3.0:1788837411.763478:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837411.763487:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837411.763495:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1875731708716032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788837411.764507:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1875731708716032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1009us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837411.764517:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837411.765739:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75810e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708716032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788837411.766209:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788837411.766291:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75810e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708716160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788837411.766379:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837411.766406:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb501109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837411.766574:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708716160 00000100:00100000:3.0:1788837411.766581:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708716160 00000100:00100000:3.0:1788837411.766625:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837411.766634:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1875731708716160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837411.766843:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5847:x1875731708716160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 209us (463us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788837411.766851:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837411.766892:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75810e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875731708716160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788837411.766938:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788837411.766977:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.766999:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.767007:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.767014:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837411.767019:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.767025:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.767050:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb50df5d00) 00010000:00010000:3.0:1788837411.767053:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788837411.767057:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837411.767063:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30619b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837411.767225:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788837411.767326:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788837411.767336:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365618031641ns, next at 366618029339ns, rc = 0 00000001:00080000:3.0:1788837411.767342:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788837411.767372:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb50df5d00) 00010000:00010000:3.0:1788837411.767374:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788837411.767382:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306186 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd87 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837411.767463:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:11615:x1875731688806656:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 13390us (13595us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788837411.767471:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000020:00080000:3.0:1788837411.767474:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000001:00080000:3.0:1788837411.769125:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788837411.769154:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:3.0:1788837411.773937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837411.774029:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688806912 00000100:00100000:1.0:1788837411.774039:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688806912 00000100:00100000:1.0:1788837411.774096:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:1.0:1788837411.774107:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+50:11615:x1875731688806912:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837411.774129:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837411.774164:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3061a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd8e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.774224:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3061a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd8e expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.774239:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3061a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd8e expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.774259:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:1.0:1788837411.774262:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837411.774265:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577000, rc 0) 00000100:00100000:1.0:1788837411.774452:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:11615:x1875731688806912:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 346us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837411.774460:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:3.0:1788837411.782767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837411.782862:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688807168 00000100:00100000:2.0:1788837411.782872:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688807168 00000100:00100000:2.0:1788837411.782928:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:2.0:1788837411.782938:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+51:11615:x1875731688807168:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1788837411.783165:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:11615:x1875731688807168:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 228us (407us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788837411.783173:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:3.0:1788837411.945247:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837411.945354:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688807296 00000100:00100000:1.0:1788837411.945364:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688807296 00000100:00100000:1.0:1788837411.945418:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:1.0:1788837411.945428:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:11625:x1875731688807296:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:1.0:1788837411.945511:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945527:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945538:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945552:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945582:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945588:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945674:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945682:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945687:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837411.945722:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945734:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945741:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945748:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945754:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837411.945758:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945765:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945784:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:1.0:1788837411.945787:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837411.945791:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945797:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3061a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945810:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945816:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945821:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945826:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837411.945829:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945834:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945841:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb461b5100) 00010000:00010000:1.0:1788837411.945844:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837411.945847:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945852:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3061b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945879:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945885:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945902:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945907:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837411.945910:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945916:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945923:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:1.0:1788837411.945925:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837411.945928:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837411.945933:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3061b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837411.946024:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:11625:x1875731688807296:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 596us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837411.946032:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:0.0:1788837412.039996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837412.040108:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688807552 00000100:00100000:2.0:1788837412.040119:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688807552 00000100:00100000:2.0:1788837412.040189:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:2.0:1788837412.040213:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+52:11628:x1875731688807552:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837412.040236:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837412.040256:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd95 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040375:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040389:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040399:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040412:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040418:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040423:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040533:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be3061d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040542:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be3061d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040549:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be3061d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837412.040570:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788837412.040664:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040672:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040678:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040684:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837412.040688:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040696:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040707:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:2.0:1788837412.040710:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837412.040715:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040721:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be3061c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040733:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040739:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040755:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040761:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837412.040763:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040770:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040777:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb454ced00) 00010000:00010000:2.0:1788837412.040779:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837412.040782:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040787:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3061cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040826:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd95 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040839:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be3061d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd95 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.040846:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837412.040848:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837412.040850:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543200, rc 0) 00000100:00100000:2.0:1788837412.040909:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:11628:x1875731688807552:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 698us (937us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788837412.040925:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:0.0:1788837412.062747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837412.063011:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688807680 00000100:00100000:2.0:1788837412.063022:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688807680 00000100:00100000:2.0:1788837412.063084:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:2.0:1788837412.063096:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:11628:x1875731688807680:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1788837412.063162:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.063180:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.063192:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.063218:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.063226:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.063232:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.063237:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837412.063241:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.063248:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.063259:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837412.063276:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837412.063281:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.063288:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837412.063410:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:11628:x1875731688807680:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 316us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837412.063418:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:3.0:1788837412.066867:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837412.067134:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688807936 00000100:00100000:2.0:1788837412.067144:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688807936 00000100:00100000:2.0:1788837412.067232:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:2.0:1788837412.067243:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+54:11628:x1875731688807936:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1788837412.067545:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:11628:x1875731688807936:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 303us (686us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788837412.067553:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1788837412.214937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837412.215153:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688808192 00000100:00100000:3.0:1788837412.215175:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688808192 00000100:00100000:3.0:1788837412.215231:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 207 00000100:00100000:3.0:1788837412.215241:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+55:11638:x1875731688808192:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1788837412.215262:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837412.215265:0:7291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788837412.215292:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577c00/0x843cbef8be306163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd79 expref: 55 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.215335:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837412.215340:0:7291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837412.215353:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3061e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbd9c expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.215441:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3061ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.215454:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3061ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.215462:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3061ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837412.215471:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788837412.215605:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3061e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd9c expref: 57 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.215622:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3061ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd9c expref: 56 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.215631:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:3.0:1788837412.215639:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837412.215643:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236c00, rc 0) 00000100:00100000:3.0:1788837412.215710:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:11638:x1875731688808192:12345-192.168.203.43@tcp:101:bash.0 Request processed in 470us (780us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788837412.215716:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 207 00000100:00100000:0.0:1788837412.219418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837412.219517:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688808448 00000100:00100000:2.0:1788837412.219527:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688808448 00000100:00100000:2.0:1788837412.219591:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 208 00000100:00100000:2.0:1788837412.219602:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:11638:x1875731688808448:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:2.0:1788837412.219654:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788837412.219678:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3061ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd9c expref: 56 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.219698:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be3061d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd95 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.219725:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837412.219730:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837412.219960:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.219973:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.219995:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837412.220045:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788837412.220070:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099ec752a reply state 000000008e95bdba transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837412.220079:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837412.220164:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:11638:x1875731688808448:12345-192.168.203.43@tcp:36:bash.0 Request processed in 563us (756us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788837412.220171:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 208 00000020:00080000:2.0:1788837412.220175:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837412.222504:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.222519:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.222541:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.222548:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837412.222553:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.222560:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.222589:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:1.0:1788837412.222592:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837412.222596:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.222603:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be3061fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837412.225842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837412.226161:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688808576 00000100:00100000:1.0:1788837412.226171:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688808576 00000100:00100000:1.0:1788837412.226224:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 209 00000100:00100000:1.0:1788837412.226234:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+56:11638:x1875731688808576:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1788837412.226260:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837412.226281:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be306204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbda3 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.226390:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.226405:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.226431:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837412.226459:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788837412.226463:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837412.226482:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.226509:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be306204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbda3 expref: 58 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.226525:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbda3 expref: 57 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.226532:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:1.0:1788837412.226535:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837412.226538:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576c00, rc 0) 00000100:00100000:1.0:1788837412.226621:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:11638:x1875731688808576:12345-192.168.203.43@tcp:101:bash.0 Request processed in 389us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837412.226629:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 209 00000100:00100000:3.0:1788837412.232905:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837412.233011:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688808832 00000100:00100000:2.0:1788837412.233020:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688808832 00000100:00100000:2.0:1788837412.233070:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:2.0:1788837412.233087:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+57:11638:x1875731688808832:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:2.0:1788837412.233301:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+58:11638:x1875731688808832:12345-192.168.203.43@tcp:35:bash.0 Request processed in 223us (416us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788837412.233339:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:0.0:1788837412.376818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837412.376913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688808960 00000100:00100000:1.0:1788837412.376922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688808960 00000100:00100000:1.0:1788837412.377162:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 210 00000100:00100000:1.0:1788837412.377175:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+58:11644:x1875731688808960:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837412.377341:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837412.377362:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be306212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdaa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.377455:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306219 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.377471:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.377482:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837412.377516:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788837412.377519:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837412.377535:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.377559:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be306212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdaa expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.377578:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306219 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdaa expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.377585:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:1.0:1788837412.377588:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837412.377591:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576600, rc 0) 00000100:00100000:1.0:1788837412.377657:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:11644:x1875731688808960:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 486us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837412.377663:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 210 00000100:00100000:0.0:1788837412.387812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837412.388234:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688809088 00000100:00100000:2.0:1788837412.388257:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688809088 00000100:00100000:2.0:1788837412.388519:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:2.0:1788837412.388533:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:11644:x1875731688809088:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837412.388561:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837412.388591:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306220 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdb1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.388681:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.388699:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.388940:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.388962:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.388971:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.388976:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389549:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be306235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389560:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be306235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389568:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be306235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837412.389632:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788837412.389637:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837412.389660:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be306235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389675:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be306235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389685:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389692:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389699:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389706:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837412.389711:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389719:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389735:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:2.0:1788837412.389738:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837412.389744:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389750:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389780:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389786:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389792:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389799:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837412.389804:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389810:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389818:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb454ced00) 00010000:00010000:2.0:1788837412.389820:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837412.389823:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389829:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30622e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389878:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306220 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb1 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389907:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be306235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb1 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.389927:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837412.389930:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837412.389933:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542a00, rc 0) 00000100:00100000:2.0:1788837412.390049:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:11644:x1875731688809088:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1519us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837412.390059:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:3.0:1788837412.400129:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837412.400505:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688809216 00000100:00100000:0.0:1788837412.400518:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688809216 00000100:00100000:0.0:1788837412.400603:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1788837412.400615:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:2360:x1875731688809216:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837412.400636:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837412.400668:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542a00/0x843cbef8be306235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb1 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837412.400691:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:0.0:1788837412.400697:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837412.400770:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:2360:x1875731688809216:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 158us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837412.400778:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1788837412.405648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837412.406075:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688809472 00000100:00100000:3.0:1788837412.406090:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688809472 00000100:00100000:3.0:1788837412.406167:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:3.0:1788837412.406180:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:11644:x1875731688809472:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837412.406209:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837412.406236:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30623c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdb8 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.406584:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.406604:0:7291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbda3 expref: 60 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.406614:0:7291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.406660:0:7291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbda3 expref: 60 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837412.406675:0:7291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbda3 expref: 60 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837412.406715:0:7291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e35500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7291:1875731708716288:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837412.408008:0:7291:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fba900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837412.413808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837412.416390:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688809600 00000100:00100000:2.0:1788837412.416413:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688809600 00010000:00010000:2.0:1788837412.416481:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbda3 expref: 61 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837412.416536:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:2.0:1788837412.416548:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:2360:x1875731688809600:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837412.416569:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837412.416577:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbda3 expref: 61 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.416593:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbda3 expref: 61 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.416622:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837412.416629:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.416640:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.416673:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.416698:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837412.416778:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:2360:x1875731688809600:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 231us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837412.416786:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00010000:00010000:1.0:1788837412.420538:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be30620b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbda3 expref: 60 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837412.420601:0:7291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e35500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7291:1875731708716288:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837412.420636:0:7291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.420648:0:7291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.420654:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837412.420679:0:7291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788837412.421029:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30623c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb8 expref: 61 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.421050:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb8 expref: 60 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.421061:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:1.0:1788837412.421073:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837412.421078:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236200, rc 0) 00000100:00100000:1.0:1788837412.424517:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:11644:x1875731688809472:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 18319us (18863us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788837412.424534:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:3.0:1788837412.426923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837412.430098:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688809856 00000100:00100000:1.0:1788837412.430121:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688809856 00000100:00100000:1.0:1788837412.430220:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1788837412.430232:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:11644:x1875731688809856:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:1.0:1788837412.430274:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837412.431433:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3061a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd8e expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837412.431466:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:1.0:1788837412.431472:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837412.431575:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:11644:x1875731688809856:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 1345us (4664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837412.431585:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1788837412.434750:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837412.435109:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688809984 00000100:00100000:2.0:1788837412.435123:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688809984 00000100:00100000:2.0:1788837412.435197:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00100000:2.0:1788837412.435209:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:11644:x1875731688809984:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:2.0:1788837412.435603:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.435627:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837412.435641:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837412.435912:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788837412.436049:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:11644:x1875731688809984:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 839us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837412.436059:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00100000:2.0:1788837412.440445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837412.440544:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688810112 00000100:00100000:0.0:1788837412.440556:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688810112 00000100:00100000:0.0:1788837412.440623:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:0.0:1788837412.440650:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+59:11644:x1875731688810112:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837412.440675:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837412.440700:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdbf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837412.440773:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837412.440785:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306258 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdbf expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837412.440807:0:5845:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837412.440826:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306258 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdbf expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837412.440842:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:0.0:1788837412.440845:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837412.440994:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306258 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdbf expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837412.441006:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917ba00, rc 0) 00000100:00100000:0.0:1788837412.441148:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:11644:x1875731688810112:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 499us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837412.441157:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 214 00010000:00010000:3.0:1788837412.582409:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788837413.287458:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837413.287472:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837413.287537:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788837413.287547:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837413.287706:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708716416:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837413.287866:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74e6f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837413.294167:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708716416:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788837413.304934:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.307139:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688810240 00000100:00100000:3.0:1788837413.307160:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688810240 00000100:00100000:3.0:1788837413.307285:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:3.0:1788837413.307298:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:11645:x1875731688810240:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837413.307382:0:7291:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837413.307531:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:11645:x1875731688810240:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 236us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837413.307540:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00080000:0.0:1788837413.309146:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837413.330783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837413.331443:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688810368 00000100:00100000:2.0:1788837413.331461:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688810368 00000100:00100000:2.0:1788837413.331553:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:2.0:1788837413.331565:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:11645:x1875731688810368:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788837413.331690:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.331713:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.331729:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332590:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332614:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332625:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332656:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332665:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332671:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837413.332786:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788837413.332791:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837413.332803:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332813:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332833:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332840:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332850:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837413.332854:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332863:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332875:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:2.0:1788837413.332877:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837413.332881:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332886:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be30625f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332901:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332906:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332911:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332916:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837413.332924:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332930:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332936:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9acb454ced00) 00010000:00010000:2.0:1788837413.332938:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837413.332941:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332947:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306266 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332960:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332965:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332970:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332985:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837413.332988:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.332994:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.333002:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837413.333004:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837413.333013:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.333019:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543a00/0x843cbef8be30626d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.333109:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:11645:x1875731688810368:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 1542us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837413.333118:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:2.0:1788837413.339382:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.339472:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688810624 00000100:00100000:0.0:1788837413.339482:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688810624 00000100:00100000:0.0:1788837413.339549:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 217 00000100:00100000:0.0:1788837413.339560:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+60:11645:x1875731688810624:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837413.339580:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837413.339600:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be306274 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdc6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339693:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339708:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339719:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837413.339729:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788837413.339832:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339840:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339864:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339870:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837413.339874:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339882:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339895:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:0.0:1788837413.339898:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788837413.339902:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339907:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b600/0x843cbef8be30627b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339946:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be306274 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdc6 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339956:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:0.0:1788837413.339958:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837413.339962:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b000/0x843cbef8be306274 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdc6 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.339981:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917b000, rc 0) 00000100:00100000:0.0:1788837413.340044:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:11645:x1875731688810624:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 486us (670us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788837413.340061:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 217 00000100:00100000:1.0:1788837413.344108:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.344294:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688810752 00000100:00100000:3.0:1788837413.344332:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688810752 00000100:00100000:3.0:1788837413.344398:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:3.0:1788837413.344409:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:11645:x1875731688810752:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837413.344453:0:11703:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837413.344580:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:11645:x1875731688810752:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 172us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837413.344588:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:3.0:1788837413.356037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837413.356391:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688811008 00000100:00100000:2.0:1788837413.356404:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688811008 00000100:00100000:2.0:1788837413.356468:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 219 00000100:00100000:2.0:1788837413.356479:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:11645:x1875731688811008:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837413.356504:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837413.356508:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788837413.356543:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306219 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdaa expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.356566:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:2.0:1788837413.356571:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837413.356587:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306289 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdcd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837413.357143:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788837413.357439:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be306290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.357455:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be306290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.357482:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be306290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.357546:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be306289 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdcd expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.357563:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be306290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdcd expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.357572:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:2.0:1788837413.357575:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837413.357578:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543000, rc 0) 00000100:00100000:2.0:1788837413.357660:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+62:11645:x1875731688811008:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1182us (1637us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788837413.357669:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 219 00000100:00100000:2.0:1788837413.362062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.362781:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688811264 00000100:00100000:0.0:1788837413.362797:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688811264 00000100:00100000:1.0:1788837413.363191:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:1.0:1788837413.363207:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+62:11645:x1875731688811264:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788837413.363282:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837413.363342:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543000/0x843cbef8be306290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdcd expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363367:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:1.0:1788837413.363388:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837413.363416:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363431:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363442:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363479:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363486:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363492:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363571:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363578:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363586:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363592:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837413.363597:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363605:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363614:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:1.0:1788837413.363617:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837413.363621:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363627:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be30629e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363642:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363648:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363653:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363659:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837413.363662:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363668:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363675:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7c16fc7a (ffff9acb461b5100) 00010000:00010000:1.0:1788837413.363677:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837413.363680:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.363685:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576c00/0x843cbef8be3062a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7c16fc7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837413.363860:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:11645:x1875731688811264:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 654us (1810us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837413.363869:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:1.0:1788837413.366180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837413.366351:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688811392 00000100:00100000:2.0:1788837413.366371:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688811392 00000100:00100000:2.0:1788837413.366457:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 221 00000100:00100000:2.0:1788837413.366467:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+61:11645:x1875731688811392:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837413.366498:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837413.366527:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be3062ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdd4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.366570:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.366621:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.366639:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.366774:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543200/0x843cbef8be3062ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdd4 expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.366793:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdd4 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.366801:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:2.0:1788837413.366804:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837413.366808:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543600, rc 0) 00000100:00100000:2.0:1788837413.366901:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+62:11645:x1875731688811392:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 435us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837413.366908:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 221 00000100:00100000:0.0:1788837413.373570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.373674:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688811648 00000100:00100000:3.0:1788837413.373689:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688811648 00000100:00100000:3.0:1788837413.373766:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:3.0:1788837413.373778:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+62:11645:x1875731688811648:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837413.374007:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.374029:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.374043:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837413.374632:0:7291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788837413.374645:0:7291:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367225340167ns, next at 368225337096ns, rc = 0 00000004:00010000:3.0:1788837413.374764:0:7291:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1aaf136 reply state 000000005fe7d58d transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837413.374775:0:7291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837413.375034:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+64:11645:x1875731688811648:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1256us (1477us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788837413.375044:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 222 00010000:00010000:0.0:1788837413.379483:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.379505:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.379513:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.379520:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837413.379526:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.379535:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.379556:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:0.0:1788837413.379559:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788837413.379565:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.379572:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3062ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837413.379863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837413.380111:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688811776 00000100:00100000:1.0:1788837413.380125:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688811776 00000100:00100000:1.0:1788837413.380208:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 223 00000100:00100000:1.0:1788837413.380219:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+63:11645:x1875731688811776:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837413.380250:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837413.380274:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbddb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.380394:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbddb expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.380409:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbddb expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.380432:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:1.0:1788837413.380434:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837413.380437:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576600, rc 0) 00000100:00100000:1.0:1788837413.380511:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+64:11645:x1875731688811776:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 294us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837413.380518:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 223 00000100:00100000:3.0:1788837413.384810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.384909:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688811904 00000100:00100000:0.0:1788837413.384922:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688811904 00000100:00100000:0.0:1788837413.385043:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:0.0:1788837413.385055:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688811904:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788837413.385408:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837413.385705:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:2360:x1875731688811904:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 650us (907us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788837413.385714:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:3.0:1788837413.397845:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837413.398007:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688812160 00000100:00100000:2.0:1788837413.398019:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688812160 00000100:00100000:2.0:1788837413.398090:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1788837413.398101:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+64:11645:x1875731688812160:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837413.398547:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+65:11645:x1875731688812160:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 447us (716us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788837413.398556:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:3.0:1788837413.405496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837413.405622:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688812416 00000100:00100000:1.0:1788837413.405635:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688812416 00000100:00100000:1.0:1788837413.405711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:1.0:1788837413.405723:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+65:11645:x1875731688812416:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788837413.405894:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+65:11645:x1875731688812416:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 173us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837413.405903:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:3.0:1788837413.409180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837413.409343:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688812544 00000100:00100000:1.0:1788837413.409372:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688812544 00000100:00100000:1.0:1788837413.409445:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 225 00000100:00100000:1.0:1788837413.409457:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+65:11645:x1875731688812544:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837413.409482:0:7291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837413.409508:0:7291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3062c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbde2 expref: -99 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.409592:0:7291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3062cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.409609:0:7291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3062cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.409623:0:7291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3062cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837413.409666:0:7291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788837413.409689:0:7291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3062cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.409715:0:7291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577000/0x843cbef8be3062c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde2 expref: 67 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.409736:0:7291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3062cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde2 expref: 66 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.409745:0:7291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:1.0:1788837413.409748:0:7291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788837413.409752:0:7291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576a00, rc 0) 00000100:00100000:1.0:1788837413.409866:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+66:11645:x1875731688812544:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 410us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837413.409889:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 225 00000100:00100000:0.0:1788837413.431733:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.431830:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688812672 00000100:00100000:3.0:1788837413.431851:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688812672 00000100:00100000:3.0:1788837413.431930:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:3.0:1788837413.431959:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+10:2361:x1875731688812672:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837413.431991:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837413.432016:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbde9 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837413.432046:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7e26, blocks: 0x1 00010000:00010000:3.0:1788837413.432070:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788837413.432075:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837413.432086:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde9 expref: 11 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.432110:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde9 expref: 11 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.432126:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236600, rc 0) 00000100:00100000:3.0:1788837413.432205:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:2361:x1875731688812672:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 248us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837413.432212:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:3.0:1788837413.436516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837413.438488:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688812928 00000100:00100000:2.0:1788837413.438529:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688812928 00000100:00100000:0.0:1788837413.439072:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00100000:0.0:1788837413.439088:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+66:11645:x1875731688812928:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837413.439243:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+66:11645:x1875731688812928:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 159us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837413.439251:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00100000:1.0:1788837413.442352:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.442533:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688813056 00000100:00100000:0.0:1788837413.442546:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688813056 00000100:00100000:0.0:1788837413.442662:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:0.0:1788837413.442676:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+11:11645:x1875731688813056:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837413.442699:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837413.442725:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdf0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.442767:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde9 expref: 12 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.442777:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837413.442782:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837413.442787:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 12 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.442843:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde9 expref: 12 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.442869:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde9 expref: 12 pid: 6701 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837413.442891:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1875731708716544:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837413.443062:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e12a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837413.448908:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1875731708716544:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837413.448952:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 12 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.448993:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7917b600, rc 0) 00000100:00100000:2.0:1788837413.449066:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:11645:x1875731688813056:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 6393us (6768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837413.449076:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:3.0:1788837413.453865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837413.454284:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688813184 00000100:00100000:2.0:1788837413.454296:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688813184 00010000:00010000:2.0:1788837413.454402:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde9 expref: 12 pid: 6701 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.454444:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:2.0:1788837413.454454:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:2361:x1875731688813184:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837413.454473:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837413.454499:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde9 expref: 12 pid: 6701 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.454513:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde9 expref: 12 pid: 6701 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.454542:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031321749/0x843cbef8be3062d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde9 expref: 12 pid: 6701 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.454586:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837413.454591:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837413.454601:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 11 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.454612:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 11 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.454660:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 11 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.454675:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75811500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875731708716672:192.168.203.43@tcp:105: 00000100:00100000:2.0:1788837413.454777:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb48857000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837413.461957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.462041:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688813312 00000100:00100000:0.0:1788837413.462054:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688813312 00002000:00100000:0.0:1788837413.462130:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9acb7f52e300 x1875731688813312/t0(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:69/0 lens 504/0 e 0 to 0 dl 1788837424 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837413.462142:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb7f52e300 with x1875731688813312 ext(0->12) 00002000:00010000:0.0:1788837413.462150:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb7f52e300 00000100:00100000:0.0:1788837413.462190:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1788837413.462202:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:2361:x1875731688813312:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788837413.462878:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75811500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875731708716672:192.168.203.43@tcp:105: 00010000:00010000:2.0:1788837413.462910:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837413.462985:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+14:2361:x1875731688813184:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 8531us (9143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837413.462997:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:0.0:1788837413.463909:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:2361:x1875731688813312:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 1701us (1958us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788837413.463921:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00002000:00100000:0.0:1788837413.463934:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9acb7f52e300 x1875731688813312/t4294967320(0) o4->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:69/0 lens 504/448 e 0 to 0 dl 1788837424 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837413.463945:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb7f52e300 with x1875731688813312 ext(0->12) 00002000:00010000:0.0:1788837413.463966:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb7f52e300 00000100:00100000:1.0:1788837413.478930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.479153:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688813440 00000100:00100000:3.0:1788837413.479167:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688813440 00000100:00100000:3.0:1788837413.479238:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 227 00000100:00100000:3.0:1788837413.479250:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+66:11645:x1875731688813440:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788837413.545433:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:2.0:1788837413.545467:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1788837413.545487:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+62:11645:x1875731688813440:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 66230us (67341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837413.545524:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 227 00000020:00080000:2.0:1788837413.545553:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9acb50f9c480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788837413.545558:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb80466500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9acb50f9ce40 00000020:00080000:2.0:1788837413.545562:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb80466600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9acb75516000 00000020:00080000:3.0:1788837413.545596:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000001:00080000:2.0:1788837413.545615:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:2.0:1788837413.545640:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9acb5d2a4780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788837413.545644:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb45e5d900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9acb5d2a4300 00000020:00080000:2.0:1788837413.545647:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb45e5d600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9acb754e1800 00000004:00080000:2.0:1788837413.545662:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:1.0:1788837413.545997:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837413.546017:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708716800:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788837413.546033:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788837413.546052:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788837413.546083:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837413.546352:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708716800 00000100:00100000:3.0:1788837413.546361:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708716800 00000100:00100000:3.0:1788837413.546429:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788837413.546439:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708716800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788837413.546470:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788837413.546503:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788837413.546504:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788837413.546528:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd4f expref: 12 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.546538:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1788837413.546543:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837413.546548:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.546580:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd4f expref: 12 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.546600:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd4f expref: 12 pid: 6701 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837413.546631:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875731708717056:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837413.546688:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fbaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837413.546771:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708716928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788837413.546806:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788837413.547233:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:2.0:1788837413.547754:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837413.547771:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708717184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788837413.547816:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837413.548002:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708716928 00000100:00100000:3.0:1788837413.548010:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708716928 00000100:00100000:3.0:1788837413.548052:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708717184 00000100:00100000:3.0:1788837413.548056:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708717184 00000100:00100000:3.0:1788837413.548084:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788837413.548094:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1875731708716928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788837413.548274:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788837413.548278:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788837414 00002000:00010000:3.0:1788837413.548280:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788837413.548283:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788837414 -> 1788837414 00002000:00010000:3.0:1788837413.548286:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788837413.548366:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1875731708716928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 273us (1558us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788837413.548374:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788837413.548397:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788837413.548404:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1875731708717184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788837413.548420:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788837413.548462:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f7e24, atime: 0x0, ctime: 0x6a9f7e24, blocks: 0xb 00010000:00010000:3.0:1788837413.548470:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.548487:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788837413.548493:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837413.548521:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.548536:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.548544:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.548549:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.548564:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837413.548595:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837413.549775:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.549796:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237200 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837413.549802:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.549813:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.550165:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.550174:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004e1e707/0x843cbef8be3062eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.550210:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837413.550233:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837413.550237:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788837413.550789:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb7f52df80/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788837413.550801:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708716928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788837413.552293:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1875731708717184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3882us (4468us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788837413.552333:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788837413.552394:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837413.552939:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1788837413.552947:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb44fa1f80, transno 4294967307 00000100:00100000:2.0:1788837413.552984:0:3315:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9acb75810e00 x1875731708716160/t4294967309(4294967309) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1788837427 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_000.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788837413.552997:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb74c79180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788837413.553004:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708717184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788837413.553535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837413.553576:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.553587:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875731708717056:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837413.553612:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.553685:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688813568 00000100:00100000:2.0:1788837413.553694:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688813568 00010000:00010000:2.0:1788837413.553738:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd4f expref: 13 pid: 6701 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.553784:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:2.0:1788837413.553794:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+13:2360:x1875731688813568:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837413.553812:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837413.553828:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd4f expref: 13 pid: 6701 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.553842:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd4f expref: 13 pid: 6701 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.553871:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3060a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd4f expref: 13 pid: 6701 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.553890:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837413.553896:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837413.553902:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.553914:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.553946:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837413.554017:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:2360:x1875731688813568:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 224us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837413.554026:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:0.0:1788837413.554246:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688813696 00000100:00100000:0.0:1788837413.554251:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688813696 00000100:00100000:0.0:1788837413.554292:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:0.0:1788837413.554335:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+12:2361:x1875731688813696:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788837413.554620:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.554632:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.554660:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.554668:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.554686:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837413.556533:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1875731708716800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10085us (10440us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788837413.556548:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1788837413.556585:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb7f52d500/2, rc 0, transno 4294967322 00010000:00010000:3.0:1788837413.556588:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788837413.556593:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708716800:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788837413.556596:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.556682:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237a00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837413.556752:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.556766:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.556791:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.556798:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be3062e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.557502:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837413.557506:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837413.557508:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837413.610012:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788837413.614702:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1788837413.614746:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1788837413.614755:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:0.0:1788837413.615164:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688813696:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 60854us (61623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837413.615179:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1788837413.622437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837413.622797:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688813952 00000100:00100000:2.0:1788837413.622811:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688813952 00000100:00100000:2.0:1788837413.623071:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 228 00000100:00100000:2.0:1788837413.623085:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:11645:x1875731688813952:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788837413.623170:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837413.623207:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be3062cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbde2 expref: 20 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.623255:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:2.0:1788837413.623261:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837413.623357:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.623375:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.623386:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837413.623735:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e237a8c9 reply state 00000000d3b2f7fd transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.623748:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837413.623891:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:11645:x1875731688813952:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 808us (1467us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788837413.623901:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 228 00010000:00010000:1.0:1788837413.628042:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.628063:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.628072:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.628079:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837413.628085:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.628094:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.628116:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:1.0:1788837413.628119:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837413.628125:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.628728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.628800:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688814080 00000100:00100000:3.0:1788837413.628813:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688814080 00000100:00100000:3.0:1788837413.628897:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:3.0:1788837413.628909:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688814080:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788837413.629253:0:8306:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788837413.629257:0:8306:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788837414 -> 1788837413 00002000:00010000:3.0:1788837413.629260:0:8306:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788837412 00002000:00010000:3.0:1788837413.629262:0:8306:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788837414 -> 1788837413 00002000:00010000:3.0:1788837413.629265:0:8306:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788837413.629352:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2361:x1875731688814080:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 444us (630us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788837413.629361:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00010000:00010000:1.0:1788837413.629377:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542000/0x843cbef8be3062f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837413.632086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.632285:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688814336 00000100:00100000:0.0:1788837413.632298:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688814336 00000100:00100000:0.0:1788837413.632498:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 229 00000100:00100000:0.0:1788837413.632512:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:11645:x1875731688814336:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788837413.632606:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.632633:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdd4 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.632643:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.632687:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdd4 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.632702:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdd4 expref: 20 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837413.632739:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708717312:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837413.632870:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb501109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837413.636608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.636705:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688814464 00000100:00100000:3.0:1788837413.636717:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688814464 00010000:00010000:3.0:1788837413.636767:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdd4 expref: 21 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837413.636816:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:3.0:1788837413.636827:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:2360:x1875731688814464:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837413.636846:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837413.636884:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdd4 expref: 21 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.636899:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdd4 expref: 21 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.636928:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:3.0:1788837413.636934:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.636947:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.636956:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.636993:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837413.637067:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:2360:x1875731688814464:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 241us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837413.637074:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00010000:00010000:1.0:1788837413.638491:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543600/0x843cbef8be3062b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdd4 expref: 20 pid: 5844 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837413.638521:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708717312:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837413.638551:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.638564:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.638570:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.638607:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.638615:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.638623:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.638630:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837413.638634:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.638643:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.638678:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:1.0:1788837413.638681:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788837413.638695:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.638702:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917b200/0x843cbef8be3062f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837413.638793:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:11645:x1875731688814336:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 6284us (6719us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788837413.638802:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 229 00000100:00100000:0.0:1788837413.642825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.643106:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688814592 00000100:00100000:3.0:1788837413.643119:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688814592 00000100:00100000:3.0:1788837413.643196:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:3.0:1788837413.643208:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb436c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688814592:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788837413.643262:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.643285:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.643368:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837413.643373:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837413.643378:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.643419:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.643435:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 8 pid: 6700 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837413.643452:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875731708717440:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837413.643555:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7518c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837413.647772:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837413.647899:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688814720 00000100:00100000:1.0:1788837413.647911:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688814720 00010000:00010000:1.0:1788837413.647964:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 9 pid: 6700 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837413.648031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:1.0:1788837413.648044:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688814720:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837413.648064:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837413.648095:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 9 pid: 6700 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.648111:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 9 pid: 6700 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.648145:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837413.648151:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837413.648178:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.648192:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.648221:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837413.648332:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+9:2360:x1875731688814720:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 261us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837413.648342:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00010000:00010000:3.0:1788837413.649193:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e0fe6d9/0x843cbef8be3062dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf0 expref: 8 pid: 6700 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837413.649215:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875731708717440:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837413.649245:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.649257:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.649264:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.649362:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.649372:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.649381:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.649387:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237a00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837413.649392:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.649403:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.649423:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.649430:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000025845f7/0x843cbef8be306300 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837413.649509:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb436c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2360:x1875731688814592:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 6303us (6695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837413.649517:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:2.0:1788837413.653997:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.654195:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688814976 00000100:00100000:3.0:1788837413.654209:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688814976 00000100:00100000:3.0:1788837413.654290:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 230 00000100:00100000:3.0:1788837413.654338:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:11645:x1875731688814976:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837413.654442:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.654464:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.654477:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.654746:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.654759:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbddb expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.654767:0:11703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.654811:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbddb expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.654827:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbddb expref: 20 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837413.654844:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875731708717568:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837413.655125:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7518c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837413.658916:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875731708717568:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837413.658958:0:11703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.660001:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.661253:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688815104 00000100:00100000:3.0:1788837413.661267:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688815104 00010000:00010000:3.0:1788837413.661446:0:11669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbddb expref: 21 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837413.661538:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:3.0:1788837413.661550:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:2360:x1875731688815104:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837413.661569:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837413.661577:0:11669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbddb expref: 21 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.661592:0:11669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbddb expref: 21 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.661620:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be3062c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbddb expref: 21 pid: 5845 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.661640:0:11669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:3.0:1788837413.661646:0:11669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.661657:0:11669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.661665:0:11669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.661730:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837413.661810:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:2360:x1875731688815104:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 262us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837413.661818:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00010000:00010000:0.0:1788837413.661904:0:11703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.661913:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837413.662179:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788837413.662390:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788837413.662446:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788837413.662557:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11703:1875731708717696:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788837413.662627:0:11703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837413.662663:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708717696 00000100:00100000:0.0:1788837413.662667:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837413.662668:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708717696 00000100:00100000:3.0:1788837413.662719:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837413.662726:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11703:x1875731708717696:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788837413.662814:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11703:x1875731708717696:12345-0@lo:1000:mdt00_004.0 Request processed in 88us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837413.662823:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788837413.662929:0:11703:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788837413.662935:0:11703:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1788837413.662957:0:11703:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb7f52df80, transno 4294967321 00000004:00080000:2.0:1788837413.662985:0:11703:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb7f52d500, transno 4294967322 00000100:00100000:2.0:1788837413.662996:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11703:1875731708717696:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788837413.663616:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788837413.663690:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75813b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11703:1875731708717824:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788837413.663738:0:11703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837413.663766:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb796363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837413.664948:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708717824 00000100:00100000:0.0:1788837413.664963:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708717824 00000100:00100000:0.0:1788837413.665033:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837413.665043:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11703:x1875731708717824:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788837413.665381:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11703:x1875731708717824:12345-0@lo:1000:mdt00_004.0 Request processed in 339us (1643us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788837413.665390:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837413.666038:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75813b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11703:1875731708717824:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788837413.666096:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666109:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666118:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666124:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837413.666130:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666138:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666157:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb454cef00) 00010000:00010000:2.0:1788837413.666160:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837413.666165:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666171:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be30630e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666211:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666218:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666244:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666249:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837413.666253:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666259:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666268:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837413.666271:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837413.666280:0:11703:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdbf expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666295:0:11703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306258 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdbf expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666341:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdbf expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.666385:0:11703:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdbf expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.666400:0:11703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75813800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875731708717952:192.168.203.43@tcp:105: 00000100:00100000:2.0:1788837413.666490:0:11703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb796363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837413.671180:0:11703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75813800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875731708717952:192.168.203.43@tcp:105: 00010000:00010000:0.0:1788837413.671221:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671256:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306251 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671301:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671369:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671382:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671394:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671401:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671408:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671415:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837413.671420:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671428:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671442:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:0.0:1788837413.671446:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837413.671450:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671464:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917a600/0x843cbef8be306315 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671476:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671483:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671488:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671494:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837413.671498:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671504:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671513:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:0.0:1788837413.671516:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788837413.671518:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837413.671524:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be306307 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837413.671854:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:11645:x1875731688814976:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 17551us (17880us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788837413.671867:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 230 00000020:00080000:0.0:1788837413.671882:0:11703:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788837413.672726:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837413.672734:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837413.674268:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788837413.674289:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837413.675981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837413.676213:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688815232 00000100:00100000:1.0:1788837413.676226:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688815232 00000100:00100000:1.0:1788837413.676295:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1788837413.676348:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:11644:x1875731688815232:12345-192.168.203.43@tcp:49:lfs.0 00000100:00100000:1.0:1788837413.676522:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:11644:x1875731688815232:12345-192.168.203.43@tcp:49:lfs.0 Request processed in 217us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837413.676530:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1788837413.680064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837413.680180:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688815488 00000100:00100000:2.0:1788837413.680193:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688815488 00000100:00100000:2.0:1788837413.680287:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 231 00000100:00100000:2.0:1788837413.680298:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:11644:x1875731688815488:12345-192.168.203.43@tcp:58:lfs.0 00000040:00080000:2.0:1788837413.681175:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788837413.681375:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:11644:x1875731688815488:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 1076us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837413.681386:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 231 00000100:00100000:0.0:1788837413.689612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.689716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.689774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.689810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837413.689846:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688815872 00000100:00100000:0.0:1788837413.689857:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688815872 00000100:00100000:2.0:1788837413.689984:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688816000 00000100:00100000:2.0:1788837413.689989:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688816000 00000100:00100000:2.0:1788837413.690058:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:2.0:1788837413.690070:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688816000:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837413.690152:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688816000:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 84us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837413.690160:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00080000:2.0:1788837413.690202:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837413.690630:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 293 00000100:00100000:0.0:1788837413.690639:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2360:x1875731688815872:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837413.690672:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2360:x1875731688815872:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 36us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837413.690679:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 293 00000100:00100000:0.0:1788837413.690726:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688816128 00000100:00100000:0.0:1788837413.690731:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688816128 00000100:00100000:0.0:1788837413.690770:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:0.0:1788837413.690777:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2360:x1875731688816128:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837413.690809:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2360:x1875731688816128:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 33us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837413.690815:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00080000:2.0:1788837413.691039:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837413.691162:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688815744 00000100:00100000:1.0:1788837413.691256:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688815744 00000100:00100000:1.0:1788837413.691355:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1788837413.691365:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db28c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+23:11645:x1875731688815744:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788837413.695344:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788837413.695511:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788837413.695624:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.695646:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.695660:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.695671:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.695678:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.695685:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.695726:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788837413.695866:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db28c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+25:11645:x1875731688815744:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 4497us (6262us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788837413.696854:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000020:00080000:1.0:1788837413.696865:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837413.697050:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837413.697059:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.697070:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577e00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837413.697075:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.697086:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.697105:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9acb461b5c00) 00010000:00010000:3.0:1788837413.697108:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788837413.697125:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.697131:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577e00/0x843cbef8be30631c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837413.697184:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837413.697186:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837413.697188:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837413.734832:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837413.734863:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708718080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837413.734960:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837413.735265:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708718080 00000100:00100000:3.0:1788837413.735275:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708718080 00000100:00100000:3.0:1788837413.735364:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788837413.735375:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875731708718080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837413.735418:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837413.735468:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875731708718080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837413.735476:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788837413.735753:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708718464:0@lo:400:kworker.0 00000100:00100000:1.0:1788837413.735790:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837413.735813:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837413.735817:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708718336:0@lo:400:kworker.0 00000100:00100000:1.0:1788837413.735835:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837413.735862:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708718464 00000100:00100000:1.0:1788837413.735865:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708718464 00000100:00100000:1.0:1788837413.735902:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708718336 00000100:00100000:1.0:1788837413.735923:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708718336 00000100:00100000:1.0:1788837413.735947:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788837413.735954:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708718464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837413.736016:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708718464:12345-0@lo:400:kworker.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837413.736022:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788837413.736039:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788837413.736045:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708718336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837413.736070:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708718336:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837413.736076:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788837413.736112:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708718336:0@lo:400:kworker.0 00000100:00100000:1.0:1788837413.736121:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708718464:0@lo:400:kworker.0 00000100:00100000:2.0:1788837413.736465:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708718592:0@lo:400:kworker.0 00000100:00100000:2.0:1788837413.736503:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837413.736534:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837413.736540:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708718208:0@lo:400:kworker.0 00000100:00100000:2.0:1788837413.736570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788837413.736605:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837413.736617:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708718592 00000100:00100000:2.0:1788837413.736620:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708718592 00000100:00100000:2.0:1788837413.736648:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788837413.736654:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708718592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837413.736759:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708718208 00000100:00100000:3.0:1788837413.736763:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708718208 00000100:00100000:3.0:1788837413.736785:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788837413.736791:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708718208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837413.736905:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708718080:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788837413.741058:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837413.741158:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708718592:0@lo:400:kworker.0 00000100:00100000:2.0:1788837413.744831:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708718592:12345-0@lo:400:kworker.0 Request processed in 8158us (8308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837413.744875:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788837413.747932:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708718208:12345-0@lo:400:kworker.0 Request processed in 11127us (11348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837413.747968:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788837413.748199:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708718208:0@lo:400:kworker.0 00000100:00100000:0.0:1788837413.753372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837413.753540:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688816256 00000100:00100000:2.0:1788837413.753555:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688816256 00000100:00100000:2.0:1788837413.753637:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 232 00000100:00100000:2.0:1788837413.753649:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+25:11648:x1875731688816256:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837413.753693:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837413.753720:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be306323 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.753834:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.753854:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.753867:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.753883:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.753891:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.753898:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.754209:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.754222:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb8 expref: 26 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.754239:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.754282:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb8 expref: 26 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.754299:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb8 expref: 26 pid: 7291 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.754350:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75811500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708718720:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837413.755300:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79636900 going to sleep for 11 seconds 00000100:00100000:0.0:1788837413.765543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837413.765704:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688816512 00000100:00100000:3.0:1788837413.765717:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688816512 00000100:00100000:3.0:1788837413.765781:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:3.0:1788837413.765792:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:5595:x1875731688816512:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788837413.766125:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:5595:x1875731688816512:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 333us (597us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788837413.766134:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:2.0:1788837413.767393:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75811500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875731708718720:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837413.767430:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837413.771094:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837413.771365:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688816640 00000100:00100000:1.0:1788837413.771379:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688816640 00010000:00010000:1.0:1788837413.771432:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb8 expref: 28 pid: 7291 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837413.771473:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:1.0:1788837413.771485:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:2360:x1875731688816640:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837413.771504:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837413.771512:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb8 expref: 28 pid: 7291 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.771527:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb8 expref: 28 pid: 7291 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.771579:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306243 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdb8 expref: 28 pid: 7291 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.771601:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:1.0:1788837413.771608:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.771620:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.771630:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837413.771667:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837413.771754:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:2360:x1875731688816640:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 270us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837413.771763:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00010000:00010000:2.0:1788837413.772239:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772251:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837413.772337:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788837413.772343:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837413.772369:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772385:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772409:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772416:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772423:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772429:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837413.772433:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772441:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772451:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:2.0:1788837413.772455:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837413.772459:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772466:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30632a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772478:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772484:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772491:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772505:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837413.772508:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772516:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772525:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9acb454cef00) 00010000:00010000:2.0:1788837413.772527:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837413.772530:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772536:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542e00/0x843cbef8be306331 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772578:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542c00/0x843cbef8be306323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf7 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772594:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf7 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837413.772602:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837413.772605:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837413.772607:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542600, rc 0) 00000100:00100000:2.0:1788837413.772661:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:11648:x1875731688816256:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 19014us (19305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837413.772669:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 232 00010000:00010000:0.0:1788837414.629648:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788837414.694290:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837414.694342:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837414.694405:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788837414.694412:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837414.694994:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708718848:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788837414.695245:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb62f36cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837414.697404:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11688:1875731708718848:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837414.700818:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837414.701065:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688816768 00000100:00100000:1.0:1788837414.701079:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688816768 00000100:00100000:1.0:1788837414.701156:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 233 00000100:00100000:1.0:1788837414.701187:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:11659:x1875731688816768:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788837414.701234:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788837414.701416:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:11659:x1875731688816768:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 232us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837414.701427:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 233 00000040:00080000:1.0:1788837414.714260:0:12623:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837414.714273:0:12623:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837414.714352:0:12623:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788837414.714359:0:12623:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837414.717503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837414.717549:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688817024 00000100:00100000:3.0:1788837414.717563:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688817024 00000100:00100000:3.0:1788837414.717629:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 234 00000100:00100000:3.0:1788837414.717652:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+26:11659:x1875731688817024:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837414.717678:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837414.717704:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be30633f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbdfe expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837414.720336:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837414.720369:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837414.720383:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837414.720398:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788837414.720581:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be30633f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdfe expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837414.720603:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdfe expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837414.720614:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:3.0:1788837414.720617:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837414.720621:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237a00, rc 0) 00000100:00100000:3.0:1788837414.720721:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:11659:x1875731688817024:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 3080us (3231us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788837414.720740:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 234 00000100:00100000:0.0:1788837414.732346:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837414.732961:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688817152 00000100:00100000:2.0:1788837414.733033:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688817152 00000100:00100000:2.0:1788837414.733112:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1788837414.733126:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:2361:x1875731688817152:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837414.733144:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837414.733179:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdfe expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.733200:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837414.733207:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837414.733371:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:2361:x1875731688817152:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 248us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837414.733380:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1788837414.747053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837414.747827:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688817408 00000100:00100000:2.0:1788837414.747843:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688817408 00000100:00100000:2.0:1788837414.747952:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00100000:2.0:1788837414.747975:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+27:11659:x1875731688817408:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788837414.748085:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.748108:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.748123:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.748388:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.748933:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.748959:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.748978:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837414.748983:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.748992:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.749010:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:2.0:1788837414.749014:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837414.749019:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837414.749027:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be306354 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837414.749248:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:11659:x1875731688817408:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 1281us (2204us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788837414.749258:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 235 00000040:00080000:2.0:1788837414.750606:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837414.750619:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837414.752443:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788837414.752533:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837414.756617:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837414.756753:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688817664 00000100:00100000:2.0:1788837414.756767:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688817664 00000100:00100000:2.0:1788837414.756843:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:2.0:1788837414.756856:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+28:11659:x1875731688817664:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837414.757181:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:11659:x1875731688817664:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 327us (577us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788837414.757190:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00010000:00010000:3.0:1788837415.654077:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788837415.782936:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837415.782946:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837415.782996:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788837415.783002:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837415.783271:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837415.783297:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708718976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837415.783420:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837415.792526:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708718976 00000100:00100000:1.0:1788837415.792549:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708718976 00000100:00100000:1.0:1788837415.793151:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788837415.793167:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708718976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837415.793220:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837415.793458:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708718976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837415.793553:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708718976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 391us (10133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837415.793564:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788837415.793725:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837416.678426:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788837416.969502:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:3.0:1788837417.035589:0:12678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837417.035602:0:12678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837417.035673:0:12678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788837417.035680:0:12678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788837417.259104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837417.259224:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688817920 00000100:00100000:1.0:1788837417.259238:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688817920 00000100:00080000:3.0:1788837417.259363:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837417.260982:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:1.0:1788837417.261017:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+29:11680:x1875731688817920:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837417.261052:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837417.261080:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30635b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbe05 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837417.261237:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be306362 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837417.261256:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be306362 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837417.261273:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be306362 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837417.261287:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788837417.261478:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577600/0x843cbef8be30635b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe05 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837417.261499:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be306362 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe05 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837417.261509:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:1.0:1788837417.261512:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788837417.261517:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576a00, rc 0) 00000100:00100000:1.0:1788837417.261608:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:11680:x1875731688817920:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 607us (2518us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788837417.266039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:2.0:1788837417.267287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837417.267384:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688818048 00000100:00100000:3.0:1788837417.267396:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688818048 00000100:00100000:3.0:1788837417.267464:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00100000:3.0:1788837417.267480:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:11680:x1875731688818048:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1788837417.267597:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837417.267630:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837417.267643:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837417.267676:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837417.267690:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837417.267710:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837417.267720:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837417.267730:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837417.267741:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837417.267761:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:3.0:1788837417.267765:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837417.267771:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837417.267778:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837417.267878:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:11680:x1875731688818048:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 403us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837417.268132:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00100000:0.0:1788837417.416672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837417.416758:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688818176 00000100:00100000:1.0:1788837417.416772:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688818176 00000100:00100000:1.0:1788837417.416865:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:1.0:1788837417.416879:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2358:x1875731688818176:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:1.0:1788837417.416904:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837417.416963:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a41bb55/0x843cbef8be306377 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbe0c expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837417.416999:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f7e25, atime: 0x6a9f7e24, ctime: 0x6a9f7e25, blocks: 0xb 00010000:00010000:1.0:1788837417.417026:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1788837417.417032:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837417.417044:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a41bb55/0x843cbef8be306377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe0c expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837417.417070:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a41bb55/0x843cbef8be306377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe0c expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837417.417087:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577e00, rc 0) 00000100:00100000:1.0:1788837417.417155:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2358:x1875731688818176:12345-192.168.203.43@tcp:101:cat.0 Request processed in 280us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837417.417163:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00080000:3.0:1788837417.417353:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837417.422628:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837417.426544:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688818304 00000100:00100000:3.0:1788837417.426566:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688818304 00002000:00100000:3.0:1788837417.426634:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9acb74c7aa00 x1875731688818304/t0(0) o3->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:73/0 lens 488/0 e 0 to 0 dl 1788837428 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837417.426645:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74c7aa00 with x1875731688818304 ext(0->4095) 00002000:00010000:3.0:1788837417.426651:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb74c7aa00 00000100:00100000:3.0:1788837417.426693:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1788837417.426725:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688818304:12345-192.168.203.43@tcp:3:cat.0 00000100:00100000:3.0:1788837417.427007:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688818304:12345-192.168.203.43@tcp:3:cat.0 Request processed in 283us (4393us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788837417.427018:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00002000:00100000:3.0:1788837417.427025:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9acb74c7aa00 x1875731688818304/t0(0) o3->4c93969d-0d98-4501-b440-fa8ca1cd6478@192.168.203.43@tcp:73/0 lens 488/4536 e 0 to 0 dl 1788837428 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837417.427034:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74c7aa00 with x1875731688818304 ext(0->4095) 00002000:00010000:3.0:1788837417.427038:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb74c7aa00 00010000:00010000:3.0:1788837417.705810:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837418.728946:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837418.806812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837418.806862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837418.806896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837418.806917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837418.806951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837418.806986:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688818816 00000100:00100000:1.0:1788837418.807000:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688818816 00000100:00100000:1.0:1788837418.807071:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688818688 00000100:00100000:1.0:1788837418.807074:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688818688 00000100:00100000:1.0:1788837418.807102:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:1.0:1788837418.807113:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688818816:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837418.807227:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2360:x1875731688818816:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 114us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837418.807234:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:1.0:1788837418.807254:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:1.0:1788837418.807260:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688818688:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837418.807289:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+8:2360:x1875731688818688:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837418.807295:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:1.0:1788837418.807332:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688818432 00000100:00100000:1.0:1788837418.807336:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688818432 00000100:00100000:1.0:1788837418.807363:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 295 00000100:00100000:1.0:1788837418.807369:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2360:x1875731688818432:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837418.807394:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+13:2360:x1875731688818432:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837418.807400:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 295 00000100:00100000:3.0:1788837418.808713:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688818560 00000100:00100000:3.0:1788837418.808726:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688818560 00000100:00100000:3.0:1788837418.808778:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688818944 00000100:00100000:3.0:1788837418.808783:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688818944 00000100:00100000:3.0:1788837418.808830:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:3.0:1788837418.808848:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:2360:x1875731688818560:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837418.808921:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+31:2360:x1875731688818560:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 82us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837418.808928:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:3.0:1788837418.808957:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:3.0:1788837418.808964:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2360:x1875731688818944:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837418.808988:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:2360:x1875731688818944:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837418.808995:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00080000:3.0:1788837418.809017:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837418.809036:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837418.853817:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837418.853854:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708719104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837418.853967:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837418.854057:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708719104 00000100:00100000:1.0:1788837418.854067:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708719104 00000100:00100000:1.0:1788837418.854134:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837418.854144:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7af7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708719104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837418.854189:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837418.854240:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7af7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708719104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837418.854269:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837418.854541:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788837418.854549:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788837418.854572:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb74c79180, transno 4294967310 00000100:00100000:1.0:1788837418.854593:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708719104:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788837418.856285:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837418.858411:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708719616:0@lo:400:kworker.0 00000100:00100000:3.0:1788837418.858505:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837418.858562:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788837418.858569:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708719232:0@lo:400:kworker.0 00000100:00100000:3.0:1788837418.858602:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837418.858623:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708719744:0@lo:400:kworker.0 00000100:00100000:3.0:1788837418.858653:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837418.858687:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708719744 00000100:00100000:3.0:1788837418.858697:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708719744 00000100:00100000:3.0:1788837418.858765:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788837418.858775:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708719744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837418.858837:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708719744:12345-0@lo:400:kworker.0 Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837418.858845:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788837418.858871:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837418.858910:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708719744:0@lo:400:kworker.0 00000100:00100000:1.0:1788837418.859290:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708719616 00000100:00100000:1.0:1788837418.859296:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708719616 00000100:00100000:1.0:1788837418.859374:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837418.859383:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1875731708719616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837418.859435:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1875731708719616:12345-0@lo:400:kworker.0 Request processed in 53us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837418.859441:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837418.859475:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708719616:0@lo:400:kworker.0 00000100:00100000:0.0:1788837418.862456:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708719488:0@lo:400:kworker.0 00000100:00100000:0.0:1788837418.862561:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837418.862622:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837418.862631:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708719360:0@lo:400:kworker.0 00000100:00100000:0.0:1788837418.862658:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837418.862701:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708719232 00000100:00100000:0.0:1788837418.862709:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708719232 00000100:00100000:0.0:1788837418.862763:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788837418.862775:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708719232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837418.862836:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708719232:12345-0@lo:400:kworker.0 Request processed in 63us (4233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837418.862855:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788837418.862928:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708719488 00000100:00100000:0.0:1788837418.862932:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708719488 00000100:00100000:0.0:1788837418.862974:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708719360 00000100:00100000:0.0:1788837418.862977:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708719360 00000100:00100000:0.0:1788837418.863022:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788837418.863029:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708719488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837418.863070:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708719488:12345-0@lo:400:kworker.0 Request processed in 42us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837418.863077:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788837418.863090:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788837418.863095:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708719360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837418.863139:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708719360:12345-0@lo:400:kworker.0 Request processed in 44us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837418.863145:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788837418.863526:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708719360:0@lo:400:kworker.0 00000100:00100000:0.0:1788837418.863539:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708719488:0@lo:400:kworker.0 00000100:00100000:1.0:1788837418.865409:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708719232:0@lo:400:kworker.0 00000100:00080000:3.0:1788837418.872484:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837418.872497:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788837418.994607:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788837418.994637:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788837419.020244:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000001:00080000:2.0:1788837419.020282:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788837419.020342:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9acb79636600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788837419.020349:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb48beee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9acb79636c00 00000020:00080000:2.0:1788837419.020352:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9acb48beec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9acb48b88000 00000020:00080000:2.0:1788837419.020392:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788837419.020397:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:2.0:1788837419.020606:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788837419.020820:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788837419.752819:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837420.773556:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837420.901551:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708719872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837420.901649:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837420.901748:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708719872 00000100:00100000:2.0:1788837420.901757:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708719872 00000100:00100000:2.0:1788837420.901827:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788837420.901852:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708719872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837420.901894:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837420.901954:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708719872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837420.901963:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788837420.902001:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837420.902039:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788837420.902046:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788837420.902078:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708719872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837421.800456:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837422.822589:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837422.994722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837422.994804:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688819072 00000100:00100000:3.0:1788837422.994825:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688819072 00000100:00100000:3.0:1788837422.994953:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 238 00000100:00100000:3.0:1788837422.994966:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f52df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11325:x1875731688819072:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788837422.995132:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f52df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11325:x1875731688819072:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 168us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837422.995141:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 238 00000100:00080000:2.0:1788837422.995698:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837423.003441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837423.003558:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688819328 00000100:00100000:0.0:1788837423.003574:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688819328 00000100:00100000:0.0:1788837423.003642:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:0.0:1788837423.003654:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:11325:x1875731688819328:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788837423.004110:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:11325:x1875731688819328:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 455us (681us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788837423.004119:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:0.0:1788837423.261111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837423.261378:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688819456 00000100:00100000:3.0:1788837423.261392:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688819456 00000100:00100000:3.0:1788837423.261488:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 239 00000100:00100000:3.0:1788837423.261502:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+5:12131:x1875731688819456:12345-192.168.203.43@tcp:101:lsof.0 00010000:00010000:3.0:1788837423.261530:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837423.261555:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be30637e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbe13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837423.261646:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306385 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837423.261664:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837423.261682:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837423.261731:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788837423.261736:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837423.261768:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837423.261981:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237400/0x843cbef8be30637e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe13 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837423.262027:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306385 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe13 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837423.262038:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5300) 00010000:00010000:3.0:1788837423.262042:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837423.262045:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237c00, rc 0) 00000100:00100000:3.0:1788837423.262123:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:12131:x1875731688819456:12345-192.168.203.43@tcp:101:lsof.0 Request processed in 625us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837423.262130:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 239 00000100:00080000:2.0:1788837423.263018:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837423.852721:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837423.925419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837423.925470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837423.925513:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837423.925545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837423.925787:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688819968 00000100:00100000:3.0:1788837423.925797:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688819968 00000100:00100000:3.0:1788837423.925864:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688819840 00000100:00100000:3.0:1788837423.925868:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688819840 00000100:00100000:0.0:1788837423.925894:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688819584 00000100:00100000:3.0:1788837423.925916:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:0.0:1788837423.925917:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688819584 00000100:00100000:3.0:1788837423.925933:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688819968:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837423.925992:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 297 00000100:00100000:0.0:1788837423.926006:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2359:x1875731688819584:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837423.926019:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2359:x1875731688819968:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 88us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837423.926029:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:3.0:1788837423.926054:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:3.0:1788837423.926064:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2359:x1875731688819840:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837423.926074:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a575dfc0-4c49-4066-9796-b14a96701d37+13:2359:x1875731688819584:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 68us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837423.926099:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 297 00000100:00100000:3.0:1788837423.926107:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2359:x1875731688819840:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837423.926117:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00080000:2.0:1788837423.926549:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837423.926554:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837423.926691:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688819712 00000100:00100000:1.0:1788837423.926697:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688819712 00000100:00100000:1.0:1788837423.926743:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 157 00000100:00100000:1.0:1788837423.926751:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:2359:x1875731688819712:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837423.926823:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:2359:x1875731688819712:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 73us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837423.926831:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 157 00000100:00100000:2.0:1788837423.973717:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837423.973738:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708720000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837423.973805:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837423.973889:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708720000 00000100:00100000:2.0:1788837423.973897:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708720000 00000100:00100000:2.0:1788837423.973959:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788837423.973968:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708720000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837423.974004:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837423.974045:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708720000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837423.974052:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788837423.974074:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837423.974105:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708720000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837423.976148:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708720512:0@lo:400:kworker.0 00000100:00100000:2.0:1788837423.976442:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708720128:0@lo:400:kworker.0 00000100:00100000:2.0:1788837423.976496:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837423.976558:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708720640:0@lo:400:kworker.0 00000100:00100000:2.0:1788837423.976593:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837423.976626:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837423.976635:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708720256:0@lo:400:kworker.0 00000100:00100000:2.0:1788837423.976673:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837423.976912:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708720128 00000100:00100000:1.0:1788837423.976920:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708720128 00000100:00100000:1.0:1788837423.977104:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788837423.977114:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708720128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977170:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708720128:12345-0@lo:400:kworker.0 Request processed in 58us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837423.977177:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788837423.977212:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708720640 00000100:00100000:1.0:1788837423.977216:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708720640 00000100:00100000:1.0:1788837423.977250:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708720256 00000100:00100000:1.0:1788837423.977253:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708720256 00000100:00100000:1.0:1788837423.977272:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837423.977493:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708720640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977530:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708720640:12345-0@lo:400:kworker.0 Request processed in 252us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837423.977537:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837423.977550:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788837423.977556:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708720256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977581:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708720256:12345-0@lo:400:kworker.0 Request processed in 26us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837423.977587:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788837423.977614:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837423.977639:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837423.977646:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708720384:0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977671:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788837423.977693:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837423.977702:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708720384 00000100:00100000:1.0:1788837423.977717:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708720384 00000100:00100000:1.0:1788837423.977744:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788837423.977750:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708720384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977782:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708720384:12345-0@lo:400:kworker.0 Request processed in 32us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837423.977788:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788837423.977802:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837423.977839:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708720384:0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977872:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708720256:0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977880:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708720128:0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977889:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708720640:0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977926:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708720512 00000100:00100000:1.0:1788837423.977929:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708720512 00000100:00100000:1.0:1788837423.977957:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837423.977964:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708720512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837423.977999:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708720512:12345-0@lo:400:kworker.0 Request processed in 35us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837423.978005:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788837423.978021:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837423.978038:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708720512:0@lo:400:kworker.0 00000001:00080000:2.0:1788837424.023166:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788837424.023195:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788837424.023277:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788837424.023294:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788837424.869582:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837425.894597:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788837426.022208:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837426.022222:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788837426.024761:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837426.024794:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708720768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837426.024900:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788837426.025084:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788837426.025097:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788837426.025296:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708720768 00000100:00100000:2.0:1788837426.025324:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708720768 00000100:00100000:2.0:1788837426.025406:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788837426.025417:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708720768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837426.025458:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837426.025527:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708720768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837426.025535:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788837426.025873:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708720768:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788837426.025959:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788837426.922145:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788837427.900937:0:12876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:17:06 (1788837426) 00010000:00010000:3.0:1788837427.944442:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837428.967107:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837429.050395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837429.050449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837429.050492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837429.050517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837429.050547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837429.050581:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688820096 00000100:00100000:2.0:1788837429.050594:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688820096 00000100:00100000:2.0:1788837429.050669:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 299 00000100:00100000:2.0:1788837429.050681:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688820096:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837429.050768:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+13:2361:x1875731688820096:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837429.050776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 299 00000100:00100000:2.0:1788837429.050834:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688820480 00000100:00100000:2.0:1788837429.050838:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688820480 00000100:00100000:2.0:1788837429.050988:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688820352 00000100:00100000:2.0:1788837429.050992:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688820352 00000100:00100000:2.0:1788837429.051019:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:2.0:1788837429.051026:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688820480:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837429.051070:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2361:x1875731688820480:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 44us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837429.051078:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:2.0:1788837429.051089:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:2.0:1788837429.051096:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688820352:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837429.051121:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2361:x1875731688820352:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837429.051127:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:2.0:1788837429.051146:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688820224 00000100:00100000:2.0:1788837429.051150:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688820224 00000100:00100000:2.0:1788837429.052267:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688820608 00000100:00100000:2.0:1788837429.052278:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688820608 00000100:00100000:2.0:1788837429.052323:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:2.0:1788837429.052333:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:2361:x1875731688820224:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837429.052393:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:2361:x1875731688820224:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 62us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837429.052400:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:2.0:1788837429.052417:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:2.0:1788837429.052423:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2361:x1875731688820608:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837429.052447:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2361:x1875731688820608:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837429.052468:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00080000:2.0:1788837429.058515:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837429.058528:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837429.058532:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837429.097134:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708720896:0@lo:400:kworker.0 00000100:00100000:1.0:1788837429.097228:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837429.099578:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708721280:0@lo:400:kworker.0 00000100:00100000:2.0:1788837429.099672:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837429.102666:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708721152:0@lo:400:kworker.0 00000100:00100000:0.0:1788837429.102765:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837429.107404:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb58745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708721024:0@lo:400:kworker.0 00000100:00100000:0.0:1788837429.107513:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837429.113373:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708721280 00000100:00100000:3.0:1788837429.113395:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708721280 00000100:00100000:3.0:1788837429.113475:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788837429.113487:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708721280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837429.113604:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708721280:12345-0@lo:400:kworker.0 Request processed in 119us (13932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837429.113612:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788837429.113640:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837429.115056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708721152 00000100:00100000:0.0:1788837429.115073:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708721152 00000100:00100000:0.0:1788837429.115265:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708721024 00000100:00100000:0.0:1788837429.115269:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708721024 00000100:00100000:0.0:1788837429.115321:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788837429.115334:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708721152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837429.115443:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708721152:12345-0@lo:400:kworker.0 Request processed in 113us (12679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837429.115452:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788837429.115474:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788837429.115481:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708721024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837429.115513:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708721024:12345-0@lo:400:kworker.0 Request processed in 33us (8002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837429.115534:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788837429.116054:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708721152:0@lo:400:kworker.0 00000100:00100000:0.0:1788837429.116073:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708721664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837429.116124:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837429.116197:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708721664 00000100:00100000:0.0:1788837429.116202:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708721664 00000100:00100000:0.0:1788837429.116242:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788837429.116250:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708721664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837429.116287:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837429.116359:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708721664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837429.116366:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788837429.116400:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708721664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837429.116645:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708721280:0@lo:400:kworker.0 00000100:00080000:2.0:1788837429.118379:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837429.118391:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837429.118938:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708720896 00000100:00100000:1.0:1788837429.118951:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708720896 00000100:00100000:1.0:1788837429.119052:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788837429.119064:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708720896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837429.119175:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708720896:12345-0@lo:400:kworker.0 Request processed in 114us (21948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837429.119183:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788837429.119760:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708721408:0@lo:400:kworker.0 00000100:00100000:1.0:1788837429.119809:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837429.119844:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708721408 00000100:00100000:1.0:1788837429.119848:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708721408 00000100:00100000:1.0:1788837429.119902:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788837429.119910:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708721408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837429.119945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708721408:12345-0@lo:400:kworker.0 Request processed in 37us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837429.119951:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1788837429.119970:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837429.120003:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708721408:0@lo:400:kworker.0 00000100:00100000:1.0:1788837429.120038:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708720896:0@lo:400:kworker.0 00000100:00100000:1.0:1788837429.122465:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb58745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708721024:0@lo:400:kworker.0 00000100:00100000:1.0:1788837429.122487:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7f52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708721536:0@lo:400:kworker.0 00000100:00100000:1.0:1788837429.124136:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837429.124558:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708721536 00000100:00100000:2.0:1788837429.124571:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708721536 00000100:00100000:2.0:1788837429.124636:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788837429.124648:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708721536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837429.124748:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708721536:12345-0@lo:400:kworker.0 Request processed in 102us (2191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837429.124756:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788837429.124808:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7f52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708721536:0@lo:400:kworker.0 00010000:00010000:3.0:1788837429.990990:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837431.013786:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837431.143447:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837431.143483:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708721792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837431.143551:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837431.144119:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708721792 00000100:00100000:2.0:1788837431.144129:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708721792 00000100:00100000:2.0:1788837431.144191:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788837431.144210:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708721792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837431.144252:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837431.144324:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708721792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837431.144331:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788837431.144482:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837431.144546:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708721792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837432.038042:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837432.621975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837432.622289:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688820864 00000100:00100000:1.0:1788837432.622300:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688820864 00000100:00100000:1.0:1788837432.622405:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:1.0:1788837432.622423:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+18:12353:x1875731688820864:12345-192.168.203.43@tcp:35:umount.0 00000100:00080000:2.0:1788837432.622874:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837432.623003:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:12353:x1875731688820864:12345-192.168.203.43@tcp:35:umount.0 Request processed in 586us (1035us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788837432.623013:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:2.0:1788837432.628357:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837432.629533:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688821120 00000100:00100000:1.0:1788837432.629556:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688821120 00000100:00100000:1.0:1788837432.629628:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:1.0:1788837432.629641:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+19:12353:x1875731688821120:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:1.0:1788837432.631231:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:12353:x1875731688821120:12345-192.168.203.43@tcp:35:umount.0 Request processed in 1585us (2874us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788837432.631243:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:2.0:1788837432.648173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837432.648259:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688821376 00000100:00100000:0.0:1788837432.648269:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688821376 00000100:00100000:0.0:1788837432.648352:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:0.0:1788837432.648363:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb5db2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+20:12353:x1875731688821376:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:0.0:1788837432.648595:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb5db2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:12353:x1875731688821376:12345-192.168.203.43@tcp:35:umount.0 Request processed in 233us (431us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788837432.648603:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:0.0:1788837432.654497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837432.654603:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688821632 00000100:00100000:2.0:1788837432.654613:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688821632 00000100:00100000:2.0:1788837432.654678:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:2.0:1788837432.654689:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+21:12353:x1875731688821632:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:2.0:1788837432.655058:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:12353:x1875731688821632:12345-192.168.203.43@tcp:35:umount.0 Request processed in 370us (569us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788837432.655066:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:2.0:1788837432.663564:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837432.663656:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837432.670597:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688821888 00000100:00100000:0.0:1788837432.670625:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688821888 00000100:00100000:2.0:1788837432.670675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837432.670687:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688821760 00000100:00100000:0.0:1788837432.670692:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688821760 00000100:00100000:0.0:1788837432.670709:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688822016 00000100:00100000:0.0:1788837432.670711:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688822016 00000100:00100000:0.0:1788837432.670728:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1788837432.670737:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a575dfc0-4c49-4066-9796-b14a96701d37+15:2359:x1875731688821888:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837432.670751:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837432.670927:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f577800/0x843cbef8be305363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb966 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837432.670944:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837432.670992:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a575dfc0-4c49-4066-9796-b14a96701d37+14:2359:x1875731688821888:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 256us (7437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837432.670999:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1788837432.671018:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1788837432.671152:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:1.0:1788837432.671169:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79045880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a575dfc0-4c49-4066-9796-b14a96701d37+13:2358:x1875731688822016:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837432.671180:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837432.671193:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f577a00/0x843cbef8be3055e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba69 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837432.671204:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837432.671233:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79045880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a575dfc0-4c49-4066-9796-b14a96701d37+12:2358:x1875731688822016:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 72us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837432.671240:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1788837432.673955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837432.674397:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688822144 00000100:00100000:3.0:1788837432.674417:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688822144 00000100:00080000:2.0:1788837432.674473:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837432.674486:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:3.0:1788837432.674498:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2357:x1875731688822144:12345-192.168.203.43@tcp:9:umount.0 00000020:00000080:3.0:1788837432.674524:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be3056d5 00000100:00080000:3.0:1788837432.674533:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9acb44fcc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837432.674576:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1788837432.674626:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837432.674859:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c93969d-0d98-4501-b440-fa8ca1cd6478+2:2357:x1875731688822144:12345-192.168.203.43@tcp:9:umount.0 Request processed in 363us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837432.674868:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:1.0:1788837432.682109:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a575dfc0-4c49-4066-9796-b14a96701d37+11:2358:x1875731688821760:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837432.682133:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837432.682157:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f576000/0x843cbef8be3053fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb99e expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837432.682172:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837432.682240:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2358:x1875731688821760:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 11215us (18583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837432.682249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1788837432.688796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837432.688877:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688822528 00000100:00100000:2.0:1788837432.688887:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688822528 00000100:00100000:2.0:1788837432.688969:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:2.0:1788837432.688994:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2357:x1875731688822528:12345-192.168.203.43@tcp:9:umount.0 00000020:00000080:2.0:1788837432.689024:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30593d 00000020:00010000:2.0:1788837432.689032:0:6701:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9acb7f694800: total 0 00000100:00080000:2.0:1788837432.689036:0:6701:0:(import.c:65:import_set_state_nolock()) ffff9acb7f697000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788837432.689223:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1788837432.689354:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788837432.689623:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c93969d-0d98-4501-b440-fa8ca1cd6478+5:2357:x1875731688822528:12345-192.168.203.43@tcp:9:umount.0 Request processed in 644us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837432.689631:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00000020:00010000:0.0:1788837432.697439:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9acb7f694800: total 0 00010000:00010000:1.0:1788837432.698084:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9acb7f694800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788837432.698144:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000308d0061/0x843cbef8be305cd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc3e expref: 4 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837432.698179:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a41bb55/0x843cbef8be306377 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe0c expref: 3 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837432.698193:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9acb7f694800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788837432.698206:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837432.698208:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837432.698210:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837432.737214:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837432.737402:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688823552 00000100:00100000:0.0:1788837432.737413:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688823552 00000100:00100000:0.0:1788837432.737476:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 240 00000100:00100000:0.0:1788837432.737488:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+22:2357:x1875731688823552:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:0.0:1788837432.737522:0:7291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305371 00000020:00010000:0.0:1788837432.737545:0:7291:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9acb7ae2d800: total 0 00000100:00080000:0.0:1788837432.737550:0:7291:0:(import.c:65:import_set_state_nolock()) ffff9acb7915a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837432.737584:0:7291:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1788837432.738147:0:5833:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9acb7ae2d800: total 0 00010000:00010000:3.0:1788837432.738152:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837432.738191:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9acb7ae2d800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788837432.738231:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837432.738234:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837432.738242:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40031200/0x843cbef8be305c9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc29 expref: 23 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738263:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:3.0:1788837432.738265:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837432.738269:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306338 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdf7 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738281:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5300) 00010000:00010000:3.0:1788837432.738283:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837432.738287:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917be00/0x843cbef8be305d3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc5a expref: 21 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738298:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837432.738301:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788837432.738349:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa5c00/0x843cbef8be305998 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbb65 expref: 20 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738364:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9acb454cea00) 00010000:00010000:3.0:1788837432.738366:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837432.738370:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4e00/0x843cbef8be30563b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba77 expref: 19 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738384:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837432.738387:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788837432.738390:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030400/0x843cbef8be305cc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc37 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738415:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837432.738417:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788837432.738422:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576e00/0x843cbef8be306036 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbd33 expref: 17 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738431:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:3.0:1788837432.738434:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788837432.738437:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576a00/0x843cbef8be306362 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe05 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738458:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9acb4556d900) 00010000:00010000:3.0:1788837432.738460:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788837432.738464:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb4167b400/0x843cbef8be3056ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba93 expref: 15 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738478:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9acb461b5400) 00010000:00010000:3.0:1788837432.738480:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837432.738483:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7917ba00/0x843cbef8be306258 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbdbf expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738497:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9acb4556d000) 00010000:00010000:3.0:1788837432.738499:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788837432.738502:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb40030a00/0x843cbef8be305d57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbc61 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738515:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837432.738518:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837432.738526:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb46aa4c00/0x843cbef8be305bba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbbf1 expref: 12 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738541:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb45631d00) 00010000:00010000:3.0:1788837432.738543:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837432.738546:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be305657 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba7e expref: 11 pid: 7291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837432.738558:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9acb7ae2d800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788837432.738569:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837432.738571:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837432.738573:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837432.738871:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c93969d-0d98-4501-b440-fa8ca1cd6478+7:2357:x1875731688823552:12345-192.168.203.43@tcp:39:umount.0 Request processed in 1384us (1665us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788837432.738880:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 240 00010000:00010000:1.0:1788837433.061590:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837434.090205:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837434.174366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837434.174421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837434.174582:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688823808 00000100:00100000:1.0:1788837434.174605:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688823808 00000100:00100000:1.0:1788837434.174672:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:1.0:1788837434.174688:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2360:x1875731688823808:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837434.174778:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2360:x1875731688823808:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 98us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837434.174786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:2.0:1788837434.175155:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688823680 00000100:00100000:2.0:1788837434.175161:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688823680 00000100:00100000:2.0:1788837434.175204:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 301 00000100:00100000:2.0:1788837434.175219:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2360:x1875731688823680:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837434.175257:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a575dfc0-4c49-4066-9796-b14a96701d37+10:2360:x1875731688823680:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837434.175263:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 301 00000100:00080000:3.0:1788837434.176919:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837434.214826:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837434.214858:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708721920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837434.216009:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837434.217114:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708721920 00000100:00100000:0.0:1788837434.217125:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708721920 00000100:00100000:0.0:1788837434.217182:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788837434.217193:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708721920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837434.217224:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837434.217301:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708721920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837434.217325:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788837434.217374:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708721920:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788837434.217772:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837434.217879:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708722304:0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.217931:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837434.217951:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837434.217957:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708722176:0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.217977:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837434.217997:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708722432:0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218020:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837434.218037:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788837434.218042:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708722048:0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218063:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837434.218079:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708722560:0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218108:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837434.218131:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708722304 00000100:00100000:3.0:1788837434.218135:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708722304 00000100:00100000:3.0:1788837434.218165:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708722176 00000100:00100000:3.0:1788837434.218167:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708722176 00000100:00100000:3.0:1788837434.218179:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788837434.218185:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708722304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218218:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875731708722304:12345-0@lo:400:kworker.0 Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837434.218224:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788837434.218372:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708722560 00000100:00100000:3.0:1788837434.218376:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708722560 00000100:00100000:3.0:1788837434.218394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788837434.218400:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708722176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218430:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708722176:12345-0@lo:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837434.218435:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788837434.218445:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788837434.218451:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708722560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218478:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708722560:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837434.218483:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1788837434.218498:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837434.218519:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708722176:0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218529:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1875731708722304:0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218555:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708722560:0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218577:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708722432 00000100:00100000:3.0:1788837434.218579:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708722432 00000100:00100000:3.0:1788837434.218613:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788837434.218620:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708722432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837434.218653:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708722432:12345-0@lo:400:kworker.0 Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837434.218658:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788837434.218671:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837434.218685:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708722432:0@lo:400:kworker.0 00000100:00100000:1.0:1788837434.219224:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708722048 00000100:00100000:1.0:1788837434.219229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708722048 00000100:00100000:1.0:1788837434.219261:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788837434.219268:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708722048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837434.219328:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3313:x1875731708722048:12345-0@lo:400:kworker.0 Request processed in 61us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837434.219335:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788837434.221511:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708722048:0@lo:400:kworker.0 00000001:00100000:1.0:1788837434.257413:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:1.0:1788837434.257421:0:6723:0:(genops.c:885:class_export_put()) final put ffff9acb7f694800/4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:1.0:1788837434.257445:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7f694800/4c93969d-0d98-4501-b440-fa8ca1cd6478 for lustre-OST0000 00000020:00000080:1.0:1788837434.257489:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb7f697000 for lustre-OST0000 00000001:00100000:1.0:1788837434.274144:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000001:00080000:1.0:1788837434.274163:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788837434.274183:0:5867:0:(genops.c:885:class_export_put()) final put ffff9acb7ae2d800/4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:1.0:1788837434.274209:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7ae2d800/4c93969d-0d98-4501-b440-fa8ca1cd6478 for lustre-MDT0000 00000020:00000080:1.0:1788837434.274269:0:12650:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb7915a800 for lustre-MDT0000 00010000:00010000:1.0:1788837435.113887:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837435.198869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837435.198906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837435.198947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837435.198976:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688823936 00000100:00100000:3.0:1788837435.198986:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688823936 00000100:00100000:1.0:1788837435.199000:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688824064 00000100:00100000:1.0:1788837435.199006:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688824064 00000100:00100000:1.0:1788837435.199041:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688824192 00000100:00100000:1.0:1788837435.199043:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688824192 00000100:00100000:3.0:1788837435.199047:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:3.0:1788837435.199059:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+11:2361:x1875731688823936:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837435.199076:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788837435.199078:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1788837435.199088:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a575dfc0-4c49-4066-9796-b14a96701d37+12:2361:x1875731688824064:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837435.199098:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa4600/0x843cbef8be305443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9b3 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837435.199098:0:11669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837435.199110:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb4167b600/0x843cbef8be30544a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9dd expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837435.199118:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837435.199124:0:11669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837435.199179:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+10:2361:x1875731688823936:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 123us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837435.199187:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:3.0:1788837435.199204:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1788837435.199218:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+9:2359:x1875731688824192:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837435.199226:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837435.199236:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2200/0x843cbef8be3055e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbba62 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837435.199247:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837435.200575:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a575dfc0-4c49-4066-9796-b14a96701d37+8:2361:x1875731688824064:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 1481us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837435.200586:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1788837435.207156:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a575dfc0-4c49-4066-9796-b14a96701d37+7:2359:x1875731688824192:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 7927us (8196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837435.207171:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1788837435.212726:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837435.212881:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688824448 00000100:00100000:3.0:1788837435.212890:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688824448 00000100:00100000:3.0:1788837435.212946:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 241 00000100:00100000:3.0:1788837435.212956:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+6:2357:x1875731688824448:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:3.0:1788837435.212992:0:5846:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305458 00000020:00010000:3.0:1788837435.213000:0:5846:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9acb79133000: total 0 00000100:00080000:3.0:1788837435.213004:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9acb79136800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837435.213030:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1788837435.213909:0:5833:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9acb79133000: total 0 00010000:00010000:2.0:1788837435.213960:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9acb79133000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788837435.213992:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb50df5300) 00010000:00010000:2.0:1788837435.213996:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837435.214004:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237c00/0x843cbef8be306385 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe13 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837435.214026:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9acb79133000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788837435.214038:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837435.214040:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837435.214042:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837435.214090:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5f7be0-4e83-4658-a86b-643dd9b98bf6+3:2357:x1875731688824448:12345-192.168.203.43@tcp:39:umount.0 Request processed in 1133us (1374us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788837435.214100:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 241 00000100:00100000:2.0:1788837435.244820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837435.250957:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688824704 00000100:00100000:1.0:1788837435.250982:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688824704 00000100:00100000:1.0:1788837435.251072:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 303 00000100:00100000:1.0:1788837435.251084:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+7:2357:x1875731688824704:12345-192.168.203.43@tcp:251:umount.0 00000020:00000080:1.0:1788837435.251130:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30534e 00000020:00010000:1.0:1788837435.251137:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9acb6a77a800: total 0 00000100:00080000:1.0:1788837435.251141:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9acb6a778000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788837435.251234:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a575dfc0-4c49-4066-9796-b14a96701d37+3:2357:x1875731688824704:12345-192.168.203.43@tcp:251:umount.0 Request processed in 152us (6421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837435.251243:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 303 00000020:00010000:3.0:1788837435.251793:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9acb6a77a800: total 0 00010000:00010000:3.0:1788837435.251798:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837435.251850:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9acb6a77a800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788837435.251883:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa5a00/0x843cbef8be305404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbb9a5 expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837435.251899:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9acb6a77a800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788837435.251924:0:5832:0:(genops.c:885:class_export_put()) final put ffff9acb6a77a800/a575dfc0-4c49-4066-9796-b14a96701d37 00010000:00010000:3.0:1788837435.251941:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837435.251943:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837435.251945:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788837435.252474:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb6a77a800/a575dfc0-4c49-4066-9796-b14a96701d37 for MGS 00000020:00000080:1.0:1788837435.252508:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb6a778000 for MGS 00010000:00010000:2.0:1788837436.136516:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837436.262496:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837436.262516:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708722688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837436.262579:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837436.262640:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708722688 00000100:00100000:1.0:1788837436.262647:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708722688 00000100:00100000:1.0:1788837436.262721:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788837436.262747:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708722688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837436.262783:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837436.262840:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708722688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837436.262847:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788837436.262880:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837436.262917:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708722688:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788837436.263395:0:11688:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837436.263400:0:11688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837436.264197:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1788837436.264210:0:11688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788837437.158640:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788837437.233083:0:13073:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788837437.256195:0:13073:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788837437.256696:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.256711:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.256836:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.256846:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.256896:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788837437.256902:0:13073:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788837437.256926:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837437.256929:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788837437.256935:0:13073:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788837437.256959:0:13073:0:(import.c:65:import_set_state_nolock()) ffff9acb741fd000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788837437.257008:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708722816:0@lo:39:umount.0 00000100:00100000:0.0:1788837437.257076:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837437.257210:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837437.257217:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.257225:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5400 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837437.257229:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.257237:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837437.257244:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837437.257250:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788837437.257253:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788837437.257255:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788837437.257290:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.257323:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837437.257346:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.257353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5400/0x843cbef8be3053d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.257385:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837437.257387:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837437.257389:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837437.257396:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837437.257407:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708722944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837437.257437:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837437.257732:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708722816 00000100:00100000:1.0:1788837437.257851:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708722816 00000100:00100000:1.0:1788837437.257901:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788837437.257910:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875731708722816:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788837437.257934:0:11703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30516b 00000100:00080000:1.0:1788837437.257941:0:11703:0:(import.c:65:import_set_state_nolock()) ffff9acb45de4800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788837437.258047:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837437.258327:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3312:x1875731708722816:12345-0@lo:39:umount.0 Request processed in 389us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837437.258334:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788837437.258344:0:11703:0:(genops.c:885:class_export_put()) final put ffff9acb45de1000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788837437.258507:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb45de1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788837437.258551:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb45de4800 for lustre-MDT0000 00000100:00080000:0.0:1788837437.258889:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb741fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788837437.258940:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708722816:0@lo:39:umount.0 00000100:00100000:0.0:1788837437.258970:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708722944 00000100:00100000:0.0:1788837437.258974:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708722944 00000100:00100000:0.0:1788837437.259019:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788837437.259028:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3315:x1875731708722944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837437.259039:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837437.259056:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2000/0x843cbef8be3053da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3053d3 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837437.259070:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837437.259116:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3315:x1875731708722944:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837437.259123:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837437.259180:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708722944:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788837437.259251:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837437.259256:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788837437.259260:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788837437.261141:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.261158:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.261164:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.261188:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.261255:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837437.261262:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.261268:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.261273:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.261286:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261475:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837437.261483:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261490:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576200 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837437.261494:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261503:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837437.261510:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837437.261516:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788837437.261518:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788837437.261548:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261560:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837437.261604:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261611:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7f576200/0x843cbef8be3053e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053e8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261624:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837437.261627:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261633:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2e00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837437.261636:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261643:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837437.261649:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837437.261654:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788837437.261656:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788837437.261669:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261674:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837437.261680:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.261696:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837437.261698:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837437.261699:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837437.261775:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708723200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837437.261844:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837437.261895:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837437.261902:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708723072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837437.261924:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837437.261954:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708723200 00000100:00100000:1.0:1788837437.261959:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708723200 00000100:00100000:1.0:1788837437.261996:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708723072 00000100:00100000:1.0:1788837437.261999:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708723072 00000100:00100000:1.0:1788837437.262031:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837437.262040:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+19:3314:x1875731708723200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837437.262051:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837437.262063:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40031c00/0x843cbef8be30530f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be305308 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.262079:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837437.262113:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+18:3314:x1875731708723200:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837437.262119:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837437.262134:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837437.262140:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+17:3314:x1875731708723072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837437.262147:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837437.262155:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa5600/0x843cbef8be3053e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3053e1 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.262163:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837437.262183:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3314:x1875731708723072:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837437.262188:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837437.262244:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708723072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837437.262254:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708723200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837437.263041:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788837437.263050:0:13073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb413f2e00/0x843cbef8be305308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be30530f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837437.263065:0:13073:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788837437.263441:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837437.263463:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837437.263470:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837437.263476:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.263906:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837437.263915:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.263923:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb46aa5e00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:3.0:1788837437.263925:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837437.263933:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837437.263939:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837437.263944:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788837437.263947:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788837437.264026:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1788837437.264032:0:13073:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788837437.264067:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837437.264106:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.264113:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788837437.264154:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708723328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837437.264205:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837437.264266:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.264290:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5e00/0x843cbef8be30560a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be305611 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.264330:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837437.264332:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837437.264334:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837437.264461:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708723328 00000100:00100000:2.0:1788837437.264468:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708723328 00000100:00100000:2.0:1788837437.264515:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788837437.264524:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+16:3315:x1875731708723328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837437.264535:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837437.264548:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa4200/0x843cbef8be305611 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be30560a expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837437.264571:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837437.264832:0:13073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.264841:0:13073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.264848:0:13073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.264854:0:13073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.264866:0:13073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788837437.264870:0:13073:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788837437.264874:0:13073:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788837437.264900:0:13073:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788837437.264904:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788837437.264908:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837437.264913:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788837437.264918:0:13073:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9acb45de2000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788837437.264923:0:13073:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9acb7b4e6800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788837437.264930:0:13073:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9acb79133000 df5f7be0-4e83-4658-a86b-643dd9b98bf6 192.168.203.43@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788837437.264942:0:13073:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9acb44f40000) has exports, disconnecting them 00000020:00080000:1.0:1788837437.264946:0:13073:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9acb45de2000), last request at 1788837434 00000020:00000080:1.0:1788837437.264952:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be3052d0 00000100:00080000:1.0:1788837437.264966:0:13073:0:(import.c:65:import_set_state_nolock()) ffff9acb79138800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788837437.264997:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837437.265002:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.265008:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a400 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:1.0:1788837437.265011:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.265017:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837437.265023:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837437.265027:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788837437.265029:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788837437.265031:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788837437.265047:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.265052:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788837437.265442:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:3315:x1875731708723328:12345-0@lo:103:ldlm_bl.0 Request processed in 778us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837437.265450:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788837437.265476:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708723456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837437.265511:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837437.265601:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708723456 00000100:00100000:0.0:1788837437.265607:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708723456 00000100:00100000:0.0:1788837437.265646:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788837437.265654:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+15:3316:x1875731708723456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837437.265663:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837437.265674:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb40030e00/0x843cbef8be3050c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3050bc expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837437.265687:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837437.265726:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:3316:x1875731708723456:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837437.265732:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788837437.265957:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30a8965a-c42f-4c1b-a594-94749f11bd0b:3316:1875731708723456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837437.266022:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.266030:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb4167a400/0x843cbef8be3050bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3050c3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837437.266054:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837437.266055:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837437.266057:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788837437.266074:0:13073:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9acb45de2000): rc 0 00000020:00000080:1.0:1788837437.266076:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb45de2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788837437.266119:0:13073:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9acb7b4e6800), last request at 1788837434 00000020:00000080:1.0:1788837437.266124:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305205 00000100:00080000:1.0:1788837437.266137:0:13073:0:(import.c:65:import_set_state_nolock()) ffff9acb7b4e2000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788837437.266156:0:13073:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9acb7b4e6800): rc 0 00000020:00000080:1.0:1788837437.266158:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb7b4e6800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1788837437.266183:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837437.266233:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708723328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837437.266251:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788837437.266483:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb45de2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788837437.266561:0:12650:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb79138800 for lustre-MDT0000 00000004:00000080:1.0:1788837437.266696:0:13073:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa6b081803ae0 00000100:00080000:1.0:1788837437.266715:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788837437.266726:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788837437.266834:0:13073:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788837437.266890:0:13073:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788837437.266906:0:13073:0:(import.c:65:import_set_state_nolock()) ffff9acb48a17000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788837437.266920:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788837437.266922:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788837437.266930:0:13073:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788837437.266980:0:13073:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788837437.266988:0:13073:0:(import.c:65:import_set_state_nolock()) ffff9acb7913f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788837437.267013:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9acb44f40000) has no exports 00000100:00100000:0.0:1788837437.267129:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708723584:0@lo:9:umount.0 00000100:00100000:0.0:1788837437.267175:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837437.267207:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708723712:0@lo:9:umount.0 00000100:00100000:0.0:1788837437.267239:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837437.267330:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708723584 00000100:00100000:1.0:1788837437.267335:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708723584 00000100:00100000:1.0:1788837437.267372:0:8306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708723712 00000100:00100000:1.0:1788837437.267375:0:8306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708723712 00000100:00100000:1.0:1788837437.267403:0:8306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788837437.267410:0:8306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875731708723584:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788837437.267435:0:8306:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305252 00000100:00080000:1.0:1788837437.267445:0:8306:0:(import.c:65:import_set_state_nolock()) ffff9aca4139e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837437.267474:0:8306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788837437.267978:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788837437.267987:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb58744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875731708723712:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788837437.268001:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305339 00000100:00080000:0.0:1788837437.268007:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9acb79135000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837437.268031:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788837437.268146:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3312:x1875731708723712:12345-0@lo:9:umount.0 Request processed in 161us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837437.268154:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788837437.268190:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb7913f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788837437.268196:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788837437.268198:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788837437.268201:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708723712:0@lo:9:umount.0 00010000:00010000:0.0:1788837437.268219:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837437.268225:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837437.268376:0:8306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb58745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3312:x1875731708723584:12345-0@lo:9:umount.0 Request processed in 965us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837437.268382:0:8306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788837437.268399:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837437.268497:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb48a17000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788837437.268511:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788837437.268512:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788837437.268516:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708723584:0@lo:9:umount.0 00000020:00000080:2.0:1788837437.268576:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7b4e6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788837437.268631:0:12650:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb7b4e2000 for lustre-MDT0000 00000020:00080000:0.0:1788837437.275901:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9acb44f40000) has no exports 00000020:00000080:0.0:1788837437.335133:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305117 00000020:00000080:0.0:1788837437.335149:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb74627000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788837437.335218:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788837437.335548:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb74627000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788837437.336855:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837437.336867:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788837437.336871:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9acb7ade19b8) has no exports 00000020:00000080:1.0:1788837437.337140:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305110 00000020:00000080:1.0:1788837437.337147:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb46ac5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788837437.342529:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb46ac5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788837437.344474:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837437.344488:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788837437.344494:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb741d3800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788837437.344498:0:13073:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb741d3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788837437.344507:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:3.0:1788837437.347883:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837437.347906:0:7652:0:(genops.c:885:class_export_put()) final put ffff9acb79134800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788837437.347934:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:3.0:1788837437.347938:0:7652:0:(genops.c:885:class_export_put()) final put ffff9acb44fca800/4c93969d-0d98-4501-b440-fa8ca1cd6478 00000020:00000080:2.0:1788837437.347979:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb79134800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788837437.348027:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb44fca800/4c93969d-0d98-4501-b440-fa8ca1cd6478 for lustre-OST0001 00000020:00000080:2.0:1788837437.348043:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb79135000 for lustre-OST0001 00000020:00000080:2.0:1788837437.348048:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb44fcc000 for lustre-OST0001 00010000:00010000:0.0:1788837438.184839:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837439.207372:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837439.337859:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708723840:0@lo:400:kworker.0 00000100:00100000:3.0:1788837439.337922:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837439.337972:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837439.337978:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708723968:0@lo:400:kworker.0 00000100:00100000:3.0:1788837439.338019:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837439.338042:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708724096:0@lo:400:kworker.0 00000100:00100000:3.0:1788837439.338066:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837439.338093:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708723968 00000100:00100000:3.0:1788837439.338099:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708723968 00000100:00100000:3.0:1788837439.338129:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708724096 00000100:00100000:3.0:1788837439.338131:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708724096 00000100:00100000:3.0:1788837439.338147:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788837439.338155:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875731708723968:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788837439.338162:0:5846:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788837439.338195:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875731708723968:12345-0@lo:400:kworker.0 Request processed in 40us (175us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788837439.338202:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788837439.338215:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788837439.338219:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1875731708724096:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788837439.338223:0:5846:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788837439.338244:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1875731708724096:12345-0@lo:400:kworker.0 Request processed in 23us (178us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788837439.338248:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788837439.338291:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788837439.338325:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9acb7b458000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788837439.338329:0:3315:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788837439.341881:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788837439.341890:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9acb7b4e1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788837439.341894:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788837439.341917:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9acb7b4e1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837439.341922:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 188 00000100:00080000:0.0:1788837439.341930:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9acb7b4e1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1788837439.341966:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb74c78380 x1875731708724224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837439.341990:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708723968:0@lo:400:kworker.0 00000100:00100000:1.0:1788837439.342121:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1875731708724224:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788837439.342182:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837439.342228:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708724224 00000100:00100000:1.0:1788837439.342234:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708724224 00000100:00100000:1.0:1788837439.342269:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788837439.342276:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3312:x1875731708724224:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788837439.342291:0:11703:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788837439.342762:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708723840 00000100:00100000:2.0:1788837439.342768:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708723840 00000100:00100000:2.0:1788837439.342812:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788837439.342820:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:3313:x1875731708723840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837439.342871:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30a8965a-c42f-4c1b-a594-94749f11bd0b+14:3313:x1875731708723840:12345-0@lo:400:kworker.0 Request processed in 52us (4948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837439.342879:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788837439.345533:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708723840:0@lo:400:kworker.0 00000100:00080000:3.0:1788837439.358831:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9acb7b458000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837439.358839:0:3315:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 205 00000100:00080000:3.0:1788837439.359027:0:3315:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9acb7b458000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1788837439.359183:0:3315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb79631c00 x1875731708724352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837439.359209:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708724096:0@lo:400:kworker.0 00000100:00100000:0.0:1788837439.360330:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1875731708724352:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788837439.360397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837439.360457:0:7291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708724352 00000100:00100000:0.0:1788837439.360465:0:7291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708724352 00000100:00100000:0.0:1788837439.360499:0:7291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788837439.360506:0:7291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3312:x1875731708724352:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788837439.360522:0:7291:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788837439.360563:0:7291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3312:x1875731708724352:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 57us (166us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837439.360569:0:7291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1788837439.363956:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb7b458000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837439.363969:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788837439.363974:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1875731708724352:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:0.0:1788837439.398486:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837439.398497:0:6723:0:(genops.c:885:class_export_put()) final put ffff9aca4139d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837439.399399:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9aca4139d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788837439.399450:0:12650:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aca4139e000 for lustre-OST0000 00000100:00100000:1.0:1788837439.402608:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3312:x1875731708724224:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 60323us (60417us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837439.402623:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788837439.403294:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb7b4e1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837439.403300:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837439.403469:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1875731708724224:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:0.0:1788837439.435151:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df5f7be0-4e83-4658-a86b-643dd9b98bf6 00000001:00080000:0.0:1788837439.435169:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788837439.435173:0:5867:0:(genops.c:885:class_export_put()) final put ffff9acb79133000/df5f7be0-4e83-4658-a86b-643dd9b98bf6 00000020:00000080:3.0:1788837439.440051:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb79133000/df5f7be0-4e83-4658-a86b-643dd9b98bf6 for lustre-MDT0000 00000020:00000080:3.0:1788837439.440120:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb79136800 for lustre-MDT0000 00010000:00010000:0.0:1788837440.230021:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837441.253492:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837442.277436:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837443.303322:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788837443.429873:0:13073:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9acb74d7bf60 - data ffff9acb7f8c4948/ffff9acb74c0b800 00000020:01000000:3.0:1788837443.430031:0:13073:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9acb8046e960 - data ffff9acb6f13fd80/ffff9acb42d8ec00 00000001:00000004:3.0:1788837443.440717:0:13073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788837443.495794:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788837443.495802:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788837443.495823:0:13073:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837443.495826:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788837443.496137:0:7090:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788837443.496141:0:7090:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788837443.496167:0:7090:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788837443.496986:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788837443.496991:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788837443.497008:0:13073:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837443.497015:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788837443.497385:0:8100:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788837443.497389:0:8100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788837443.497399:0:8100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788837443.554587:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be3050df 00000020:00000080:1.0:1788837443.554599:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb741a2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788837443.555172:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb741a2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837443.560020:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be3050f4 00000020:00000080:0.0:1788837443.560031:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb79831000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788837443.560099:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788837443.560106:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837443.560114:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788837443.560119:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9acb44f419b8) has no exports 00000004:01000000:0.0:1788837443.560283:0:13073:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788837443.560292:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305332 00000020:00000080:0.0:1788837443.560297:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb7915f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837443.560581:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb79831000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788837443.560663:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788837443.560668:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837443.560676:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788837443.560679:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9acb7ade4d28) has no exports 00000020:00000080:0.0:1788837443.560686:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30532b 00000020:00000080:0.0:1788837443.560690:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb7913b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788837443.560712:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7915f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788837443.561141:0:13073:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788837443.561149:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788837443.561153:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788837443.561158:0:13073:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788837443.561161:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837443.561243:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7913b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837443.561293:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837443.561357:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837443.561364:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30524b 00000020:00000080:0.0:1788837443.561369:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb7b45c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788837443.561373:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788837443.561377:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837443.561381:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788837443.561383:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9acb5d3519b8) has no exports 00000020:00000080:0.0:1788837443.561387:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305244 00000020:00000080:0.0:1788837443.561390:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb48a16000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788837443.561515:0:12650:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb7913f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788837443.561522:0:12650:0:(genops.c:885:class_export_put()) final put ffff9acb7913e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837443.561524:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7913e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788837443.561529:0:12650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837443.561590:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7b45c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788837443.561595:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb48a16000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788837443.561936:0:13073:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788837443.561947:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788837443.561949:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788837443.561953:0:13073:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788837443.561955:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837443.561981:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837443.561988:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837443.562011:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837443.562015:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837443.562018:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb741fa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837443.562020:0:13073:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb741fa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788837443.562025:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837443.562149:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be3050fb 00000020:00000080:0.0:1788837443.562155:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb79837800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788837443.562161:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788837443.562164:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837443.562168:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788837443.562170:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9acb7982cd28) has no exports 00000020:00000080:0.0:1788837443.562188:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837443.562191:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788837443.562194:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305102 00000020:00000080:0.0:1788837443.562197:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb79833000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788837443.562206:0:13073:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9acb6a76b800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788837443.562209:0:13073:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb6a76b800 3 00000020:01000004:0.0:1788837443.562212:0:13073:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9acb6a76b800 from lustre-MDT0000 00000020:00000080:0.0:1788837443.562228:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837443.562231:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788837443.562234:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb741a6800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788837443.562236:0:13073:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb741a6800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788837443.562242:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788837443.562267:0:13073:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788837443.562270:0:13073:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788837443.562273:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788837443.562281:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837443.562284:0:13073:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788837443.562290:0:13073:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9acb46abf000 30a8965a-c42f-4c1b-a594-94749f11bd0b 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837443.562296:0:13073:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9acb44f44d28) has exports, disconnecting them 00000020:00080000:0.0:1788837443.562299:0:13073:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9acb46abf000), last request at 1788837219 00000020:00000080:3.0:1788837443.562349:0:12650:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb48a17000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788837443.562355:0:12650:0:(genops.c:885:class_export_put()) final put ffff9acb48a13000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837443.562357:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb48a13000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788837443.562361:0:12650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837443.562420:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb79837800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788837443.562424:0:12650:0:(genops.c:885:class_export_put()) final put ffff9acb79835000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788837443.562426:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb79835000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788837443.562431:0:12650:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788837443.562567:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb79833000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837443.563570:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be3050a0 00000020:00010000:0.0:1788837443.563575:0:13073:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9acb46abf000: total 0 00000100:00080000:0.0:1788837443.563579:0:13073:0:(import.c:65:import_set_state_nolock()) ffff9acb46abc800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788837443.563598:0:13073:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9acb46abf000): rc 0 00000020:00080000:0.0:1788837443.563602:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9acb44f44d28) has no exports 00000020:00010000:3.0:1788837443.563699:0:5833:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9acb46abf000: total 0 00010000:00010000:3.0:1788837443.563730:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9acb46abf000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788837443.563757:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f3c00/0x843cbef8be3053b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3053a9 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837443.563783:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2a00/0x843cbef8be3053be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3053b7 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837443.563812:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa4000/0x843cbef8be3053cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3053c5 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837443.563824:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb4167a000/0x843cbef8be3051b8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3051b1 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837443.563837:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7917a800/0x843cbef8be3053f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3053ef expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837443.563846:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7917a200/0x843cbef8be3055f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3055ee expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837443.563854:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb46aa4800/0x843cbef8be305603 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be3055fc expref: 3 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837443.563864:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb413f2400/0x843cbef8be3053a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x843cbef8be30539b expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837443.563873:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9acb46abf000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788837443.563885:0:5833:0:(genops.c:885:class_export_put()) final put ffff9acb46abf000/30a8965a-c42f-4c1b-a594-94749f11bd0b 00010000:00010000:3.0:1788837443.563904:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837443.563906:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837443.563908:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788837443.563943:0:12650:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb46abf000/30a8965a-c42f-4c1b-a594-94749f11bd0b for MGS 00000020:00000080:0.0:1788837443.563975:0:12650:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb46abc800 for MGS 00000100:00100000:1.0:1788837443.564065:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9acb48aa7800:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1788837443.564401:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9acb6a64ec00:5839] 2 exiting: rc = 0 00000100:00100000:2.0:1788837443.564490:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9acb48aa7200:5838] 1 exiting: rc = 0 00000100:00100000:1.0:1788837443.564524:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564534:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564540:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564549:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564557:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564565:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564572:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564578:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564584:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564590:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564595:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564601:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564607:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564614:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564620:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564625:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564631:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564636:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564642:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564648:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564657:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564662:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564679:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564685:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564692:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564701:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564709:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564717:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564736:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564745:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564752:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564759:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564766:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564788:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564797:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564807:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564816:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564825:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564832:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564839:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564850:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564862:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564873:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564879:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.564885:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565478:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565488:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565492:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565496:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565500:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565503:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565507:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565514:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565517:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565523:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565529:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565541:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565544:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565548:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565551:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565555:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565558:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565562:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.565571:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788837443.566121:0:13073:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788837443.566125:0:13073:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788837443.567013:0:13073:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9acb7f6ca900 - data ffff9acb6af5c870/ffff9acb7f6eb800 00000020:01000000:3.0:1788837443.567127:0:13073:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9acb433eaae0 - data ffff9acb6ac5a000/ffff9acb5873f000 00000020:00000080:3.0:1788837443.567562:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305084 00000020:00000080:3.0:1788837443.567568:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb46ac6800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788837443.567617:0:13073:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9acb6a76b800 from MGS, refs=2 00000020:01000004:3.0:1788837443.567619:0:13073:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb6a76b800 2 00000020:01000004:3.0:1788837443.567622:0:13073:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9acb6a76b800 from MGS 00000020:00000080:3.0:1788837443.567643:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837443.567647:0:13073:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788837443.567649:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb46ac2000/MGS 00000020:00000080:3.0:1788837443.567652:0:13073:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb46ac2000/MGS for MGS 00000020:01000000:3.0:1788837443.567656:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788837443.567695:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788837443.567698:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837443.567701:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788837443.567706:0:13073:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9acb741fe000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837443.567710:0:13073:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9acb58730000) has exports, disconnecting them 00000020:00080000:3.0:1788837443.567713:0:13073:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9acb741fe000), last request at 1788837219 00000020:00000080:3.0:1788837443.567716:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30514f 00000020:00080000:3.0:1788837443.567723:0:13073:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9acb741fe000): rc 0 00000020:00000080:3.0:1788837443.567727:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb741fe000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788837443.567748:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb46ac6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837443.567854:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb741fe000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788837443.578359:0:13073:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788837443.578368:0:13073:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837443.578373:0:13073:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788837443.578379:0:13073:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837443.578598:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837443.578606:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788837443.578612:0:13073:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb6a76b800 1 00000020:00000080:0.0:1788837443.578617:0:13073:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305076 00000020:00000080:0.0:1788837443.578625:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb46ac3800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788837443.578632:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788837443.578635:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837443.578638:0:13073:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788837443.578642:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9acb5d353370) has no exports 00000020:00000080:1.0:1788837443.581863:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb741fd000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788837443.581880:0:37:0:(genops.c:885:class_export_put()) final put ffff9acb74622800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788837443.581884:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb74622800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788837443.581895:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788837443.584433:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb46ac3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788837443.627537:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837443.627551:0:13073:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788837443.627557:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb6a76c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788837443.627570:0:13073:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb6a76c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788837443.627582:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788837443.627993:0:13073:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9acb6a76d000 00000020:01000000:1.0:1788837443.628017:0:13073:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788837443.628020:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837443.628025:0:13073:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788837443.628029:0:13073:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9acb44f43370) has no exports 00000100:00100000:1.0:1788837443.628188:0:11703:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9acb7ae3b600:11703] 4 exiting: rc = 0 00000100:00100000:1.0:1788837443.628430:0:7291:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9acb7496b200:7291] 3 exiting: rc = 0 00000100:00100000:2.0:1788837443.628569:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9acb5da59800:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788837443.628705:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9acb58709c00:5846] 2 exiting: rc = 0 00000100:00100000:1.0:1788837443.630420:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9acb58749400:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1788837443.630574:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630588:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630599:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630611:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630621:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630632:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630657:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630668:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630678:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630684:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630689:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630696:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630701:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630838:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630847:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630853:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630858:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630864:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630870:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630875:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630881:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630887:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630892:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630897:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630903:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630909:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630914:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630921:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630926:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630932:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630938:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630944:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630949:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630955:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630961:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630967:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630972:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630977:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630982:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630987:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.630993:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631000:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631005:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631011:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631016:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631022:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631028:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631034:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631047:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631053:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631059:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631065:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631070:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631076:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631082:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631087:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631093:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631098:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631103:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631108:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631113:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631118:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631123:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.631128:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.636452:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9acb5da5a000:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1788837443.637387:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9acb5da58600:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1788837443.637465:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637473:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637481:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637488:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637493:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637498:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637503:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637509:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637514:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637519:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637524:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637531:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637537:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637543:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637549:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637554:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637558:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637577:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637583:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637589:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637594:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637599:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637604:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637609:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637614:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637620:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637625:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637631:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637636:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637651:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637658:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637663:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637668:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637673:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637679:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637683:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637688:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637693:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637699:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637703:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637709:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637713:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637839:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637848:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637853:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637859:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637864:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637869:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637873:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637879:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637883:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637888:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637901:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637907:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637912:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637917:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637922:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637927:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637933:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637939:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637944:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637950:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637955:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.637961:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837443.638480:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9acb5db6b200:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1788837443.638577:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9acb5db6b800:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1788837443.639160:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639183:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639191:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639196:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639201:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639206:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639211:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639216:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639221:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639226:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639232:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639238:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639245:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639265:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639279:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639285:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639293:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639298:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639328:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639334:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639340:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639346:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639353:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639367:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639373:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639395:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639401:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639406:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639413:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639418:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639424:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639430:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639438:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639444:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639449:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639455:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639460:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639480:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639487:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639492:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639498:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639503:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639509:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639515:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639521:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639527:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639533:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639539:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639545:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639566:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639573:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639579:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639585:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639590:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639596:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639602:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639608:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639614:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639627:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639636:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639658:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639664:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639669:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.639676:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837443.647584:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9acb50ff5600:5851] 0 exiting: rc = 1 00000100:00100000:2.0:1788837443.647781:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9acb50f40e00:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1788837443.648074:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648081:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648087:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648091:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648096:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648101:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648106:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648111:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648116:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648120:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648124:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648129:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648134:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648207:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648212:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648217:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648222:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648227:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648232:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648237:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648242:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648247:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648252:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648256:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648261:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648266:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648270:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648276:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648282:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648299:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648386:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648392:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648397:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648402:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648408:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648413:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648418:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648423:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648427:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648433:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648438:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648443:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648448:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648452:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648456:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648460:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648465:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648469:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648474:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648478:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648482:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648486:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648491:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648495:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648499:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648503:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648507:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648511:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648515:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648520:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648524:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648529:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648534:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.648539:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649381:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9acb50f40400:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1788837443.649573:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9acb50f40600:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1788837443.649662:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649669:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649674:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649679:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649684:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649689:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649694:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649698:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649704:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649708:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649714:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649839:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649845:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649849:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649853:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649858:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649862:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649868:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649872:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649878:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649882:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649888:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.649892:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650114:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650120:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650125:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650130:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650197:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650205:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650210:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650216:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650221:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650225:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650230:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650247:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650252:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650257:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650262:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650266:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650272:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650277:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650281:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650287:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650292:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650297:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650366:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650373:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650379:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650384:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650389:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650395:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650400:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650405:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650410:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650415:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650420:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650424:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650429:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650435:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650439:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650444:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650449:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650453:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.650458:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837443.651020:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9acb62f91600:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1788837443.651112:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9acb46843400:5855] 0 exiting: rc = 1 00000100:00100000:1.0:1788837443.651208:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651326:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651334:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651340:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651345:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651359:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651366:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651370:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651374:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651380:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651384:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651390:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651396:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651401:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651406:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651411:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651415:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651420:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651426:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651430:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651435:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651440:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651445:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651450:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651455:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651460:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651466:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651471:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651476:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651481:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651486:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651492:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651497:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651502:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651508:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651513:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651517:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651522:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651526:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651530:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651543:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651548:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651552:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651557:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651562:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651567:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651572:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651577:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651581:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651586:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651591:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651596:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651601:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651606:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651612:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651617:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651621:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651626:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651631:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651637:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651655:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651662:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651668:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.651673:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837443.652389:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9acb50f8b000:5857] 0 exiting: rc = 1 00000100:00100000:2.0:1788837443.652708:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9acb50f8bc00:5858] 1 exiting: rc = 0 00000100:00100000:2.0:1788837443.652921:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9acb50f8ac00:5859] 2 exiting: rc = 0 00000100:00100000:1.0:1788837443.653392:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653398:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653404:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653408:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653413:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653418:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653425:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653431:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653436:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653441:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653447:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653464:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653470:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653475:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653497:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653503:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653508:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653513:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653519:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653523:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653528:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653533:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653539:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653543:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653549:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653555:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653560:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653565:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653570:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653575:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653581:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653586:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653591:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653595:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653600:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653606:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653611:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653616:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653638:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653713:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653795:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653802:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653807:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653813:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653819:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653825:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653839:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653846:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653852:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653857:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653862:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653867:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653872:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653877:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653882:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653887:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653893:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653898:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653904:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653910:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653915:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653921:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653926:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837443.653932:0:13073:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788837443.659628:0:13073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837443.659640:0:13073:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788837443.659646:0:13073:0:(genops.c:885:class_export_put()) final put ffff9acb46ac1000/MDS_uuid 00000020:00000080:0.0:1788837443.659650:0:13073:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb46ac1000/MDS_uuid for MDS 00000020:01000000:0.0:1788837443.659656:0:13073:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788837443.659788:0:13073:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788837444.325499:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837444.457386:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837444.457393:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837444.457396:0:37:0:(import.c:65:import_set_state_nolock()) ffff9acb7b4e1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837444.457405:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 393 00000100:00080000:1.0:1788837444.457410:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788837444.457417:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9acb7b4e1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1788837444.457438:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb48b8dc00 x1875731708724608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837444.457463:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837444.457466:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837444.457468:0:37:0:(import.c:65:import_set_state_nolock()) ffff9acb7b458000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837444.457471:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 393 00000100:00080000:1.0:1788837444.457481:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788837444.457485:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9acb7b458000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1788837444.457498:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb48b8d500 x1875731708724736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837444.457521:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837444.457536:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708724480:0@lo:400:kworker.0 00000400:00000100:1.0:1788837444.457584:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875731708724480 offset 0 length 224: 4 00000100:00100000:3.0:1788837444.459521:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1875731708724608:0@lo:38:kworker.0 00000400:00000100:3.0:1788837444.459573:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875731708724608 offset 0 length 520: 4 00000100:00100000:3.0:1788837444.459599:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1875731708724736:0@lo:38:kworker.0 00000400:00000100:3.0:1788837444.459614:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875731708724736 offset 0 length 520: 4 00010000:00010000:2.0:1788837445.351394:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837446.373533:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788837446.602362:0:13231:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788837446.619567:0:13231:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788837446.619622:0:13231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.619637:0:13231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.619643:0:13231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.619649:0:13231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.619675:0:13231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788837446.619680:0:13231:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788837446.619703:0:13231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788837446.619714:0:13231:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9acb48b8dc00 x1875731708724608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837459 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837446.619729:0:13231:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788837446.619734:0:13231:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788837446.619740:0:13231:0:(import.c:65:import_set_state_nolock()) ffff9acb7b4e1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788837446.619771:0:13231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788837446.619775:0:13231:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9acb48b8dc00 x1875731708724608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837459 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837446.619782:0:13231:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788837446.619785:0:13231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:2.0:1788837446.620096:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837446.620103:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837446.620110:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a000 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:2.0:1788837446.620113:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837446.620120:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837446.620124:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837446.620127:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837446.620129:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788837446.620131:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788837446.620161:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837446.620165:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788837446.620215:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708724864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837446.620227:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1875731708724608:0@lo:38:kworker.0 00000100:00100000:0.0:1788837446.620268:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837446.620333:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708724864 00000100:00100000:3.0:1788837446.620340:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708724864 00010000:00010000:2.0:1788837446.620362:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837446.620378:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be3053b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053be expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837446.620387:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837446.620388:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837446.620391:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837446.620397:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837446.620405:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1875731708724864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788837446.620412:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837446 with bad export cookie 9528700887161131168 00010000:00010000:1.0:1788837446.623931:0:13231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.624445:0:13231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.624456:0:13231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.624463:0:13231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.624488:0:13231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837446.624495:0:13231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.624503:0:13231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837446.624517:0:13231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.624520:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837446.624525:0:13231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.624530:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.624540:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f3e00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837446.624544:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.624562:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837446.624571:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837446.624576:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837446.624578:0:13231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788837446.624583:0:13231:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:01000000:0.0:1788837446.624588:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788837446.624591:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788837446.624626:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.624633:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837446.624668:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.624676:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb413f3e00/0x843cbef8be3053c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be3053cc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.624691:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837446.624694:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.624709:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f3400 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837446.624712:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.624718:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837446.624724:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837446.624729:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788837446.624731:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788837446.624733:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788837446.624746:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788837446.624797:0:13231:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788837446.624801:0:13231:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788837446.624806:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837446.624812:0:13231:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788837446.624816:0:13231:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9acb798299b8) has no exports 00000100:00100000:2.0:1788837446.624837:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708724992:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788837446.624840:0:13231:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9acb798299b8) has no exports 00000100:00100000:2.0:1788837446.624905:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837446.624965:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708724992 00000100:00100000:2.0:1788837446.624972:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708724992 00000100:00100000:2.0:1788837446.625006:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788837446.625014:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3314:x1875731708724992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788837446.625020:0:11669:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837446 with bad export cookie 9528700887161131168 00000100:00100000:2.0:1788837446.625062:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3314:x1875731708724992:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (158us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788837446.625068:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788837446.625103:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788837446.625108:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9acb46ab9800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788837446.625111:0:3314:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788837446.625292:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837446.625334:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.625341:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb413f3400/0x843cbef8be3055fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x843cbef8be305603 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837446.625353:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837446.625354:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837446.625356:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788837446.629499:0:13231:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9acb7f6cac00 - data ffff9acb6ae36d80/ffff9acb7f6ea800 00000020:01000000:1.0:1788837446.629655:0:13231:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9acb45dbfe40 - data ffff9acb6ac50af8/ffff9aca418f1000 00010000:00010000:3.0:1788837446.640440:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837446.644269:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1875731708724864:12345-0@lo:103:ldlm_bl.0 Request processed in 23852us (23989us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788837446.644283:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788837446.644556:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788837446.652957:0:3314:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.143@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788837446.652963:0:3314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788837446.652972:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9acb48b8e300 x1875731708724480/t0(0) o400->MGC192.168.203.143@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788837460 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837446.652987:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9acb79047100 x1875731708724864/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837462 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837446.652995:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9acb74c78a80 x1875731708724992/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837462 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837446.653066:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:0:1875731708725120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837446.653091:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30a8965a-c42f-4c1b-a594-94749f11bd0b:3315:1875731708724480:0@lo:400:kworker.0 10000000:01000000:2.0:1788837446.653165:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788837446.653168:0:3314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788837446.653169:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788837446.653173:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9acb46ab9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837446.653178:0:3314:0:(import.c:510:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 172 00000100:00080000:2.0:1788837446.653186:0:3314:0:(import.c:624:import_select_connection()) MGC192.168.203.143@tcp: import ffff9acb46ab9800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1788837446.653244:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb79047480 x1875731708725248/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837446.653327:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30a8965a-c42f-4c1b-a594-94749f11bd0b:3312:1875731708725248:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788837446.653374:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875731708725248 offset 0 length 520: 4 00000100:00100000:2.0:1788837446.653463:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30a8965a-c42f-4c1b-a594-94749f11bd0b:3314:1875731708724992:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788837446.654679:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9acb46ab9800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1788837446.654811:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30a8965a-c42f-4c1b-a594-94749f11bd0b:3313:1875731708724864:0@lo:103:ldlm_bl.0 00100000:10000000:1.0:1788837446.677529:0:13231:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788837446.695968:0:13231:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be3051d4 00000020:00000080:0.0:1788837446.695978:0:13231:0:(genops.c:885:class_export_put()) final put ffff9acb7f78f800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788837446.696037:0:13231:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9acb45cdf000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788837446.696040:0:13231:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb45cdf000 2 00000020:01000004:0.0:1788837446.696043:0:13231:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9acb45cdf000 from lustre-OST0000 00000020:00000080:0.0:1788837446.696066:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837446.696075:0:13231:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788837446.696078:0:13231:0:(genops.c:885:class_export_put()) final put ffff9acb7b4e4800/lustre-OST0000_UUID 00000020:00000080:0.0:1788837446.696081:0:13231:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7b4e4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788837446.696089:0:13231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788837446.696128:0:13231:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788837446.696132:0:13231:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788837446.696136:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837446.696154:0:13231:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788837446.696161:0:13231:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9acb7b4e3800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837446.696168:0:13231:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9acb79828000) has exports, disconnecting them 00000020:00080000:0.0:1788837446.696172:0:13231:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9acb7b4e3800), last request at 1788837234 00000020:00000080:0.0:1788837446.696176:0:13231:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be3051fe 00000020:00080000:0.0:1788837446.696187:0:13231:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9acb7b4e3800): rc 0 00000020:00000080:0.0:1788837446.696193:0:13231:0:(genops.c:885:class_export_put()) final put ffff9acb7b4e3800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788837446.696399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7f78f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788837446.698005:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7b4e3800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788837446.701509:0:13231:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788837446.701518:0:13231:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837446.701522:0:13231:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788837446.701529:0:13231:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788837446.701737:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837446.701746:0:13231:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788837446.701763:0:13231:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb45cdf000 1 00000020:00000080:2.0:1788837446.701772:0:13231:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30518e 00000020:00000080:2.0:1788837446.701780:0:13231:0:(genops.c:885:class_export_put()) final put ffff9acb44e3b000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788837446.701786:0:13231:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788837446.701790:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837446.701795:0:13231:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788837446.701799:0:13231:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9acb7ade0000) has no exports 00000020:00000080:3.0:1788837446.702012:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb7b4e1000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788837446.702019:0:37:0:(genops.c:885:class_export_put()) final put ffff9acb7f78d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788837446.702021:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb7f78d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788837446.702029:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788837446.702083:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb44e3b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788837446.718604:0:13231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837446.718618:0:13231:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788837446.718623:0:13231:0:(genops.c:885:class_export_put()) final put ffff9acb45cdc000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788837446.718628:0:13231:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb45cdc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788837446.718641:0:13231:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788837446.720678:0:13231:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9acb45cd8000 00000020:02000400:3.0:1788837446.720735:0:13231:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788837447.399423:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837448.421873:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788837449.034557:0:13381:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788837449.052225:0:13381:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788837449.052334:0:13381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837449.052349:0:13381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837449.052375:0:13381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837449.052383:0:13381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837449.052404:0:13381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788837449.052409:0:13381:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788837449.052430:0:13381:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837449.052440:0:13381:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9acb48b8d500 x1875731708724736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837459 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837449.052458:0:13381:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788837449.052464:0:13381:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788837449.052470:0:13381:0:(import.c:65:import_set_state_nolock()) ffff9acb7b458000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788837449.052474:0:13381:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837449.052478:0:13381:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9acb48b8d500 x1875731708724736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837459 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837449.052486:0:13381:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788837449.052488:0:13381:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:1.0:1788837449.052616:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837449.052624:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.052632:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b800 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:1.0:1788837449.052636:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.052655:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837449.052663:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837449.052677:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788837449.052680:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788837449.052683:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788837449.052695:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9acb46ab9800 00010000:00010000:1.0:1788837449.052698:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.052704:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be30539b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x843cbef8be3053a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.052715:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837449.052716:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837449.052718:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837449.052856:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1875731708724736:0@lo:38:kworker.0 00010000:00010000:3.0:1788837449.053968:0:13381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837449.053982:0:13381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837449.053990:0:13381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837449.053997:0:13381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837449.054070:0:13381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837449.054079:0:13381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837449.054086:0:13381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837449.054092:0:13381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837449.054098:0:13381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.054553:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837449.054562:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.054570:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576800 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:1.0:1788837449.054572:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.054580:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837449.054587:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837449.054592:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788837449.054594:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788837449.054612:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9acb46ab9800 00010000:00010000:1.0:1788837449.054616:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.054623:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7f576800/0x843cbef8be3053a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x843cbef8be3053b0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.054636:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837449.054639:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837449.054841:0:13381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1788837449.054848:0:13381:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788837449.054852:0:13381:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788837449.054877:0:13381:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788837449.054881:0:13381:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788837449.054886:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837449.054892:0:13381:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788837449.054896:0:13381:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9acb5d350000) has no exports 00000020:00080000:3.0:1788837449.054921:0:13381:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9acb5d350000) has no exports 00010000:00010000:1.0:1788837449.055428:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2600 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:1.0:1788837449.055436:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.055451:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837449.055458:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837449.055463:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788837449.055466:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788837449.055468:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788837449.055476:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9acb46ab9800 00010000:00010000:1.0:1788837449.055479:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.055486:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb413f2600/0x843cbef8be3055ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x843cbef8be3055f5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837449.055514:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837449.055516:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788837449.056908:0:13381:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9acb46403120 - data ffff9acb6ae8b510/ffff9acb7917f400 00000020:01000000:3.0:1788837449.057071:0:13381:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9acb457e36c0 - data ffff9acb6ae360d8/ffff9acb75271c00 00010000:00010000:0.0:1788837449.057895:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837449.058211:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788837449.069096:0:13381:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788837449.106867:0:13381:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30529f 00000020:00000080:3.0:1788837449.106877:0:13381:0:(genops.c:885:class_export_put()) final put ffff9acb79003000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788837449.107277:0:13381:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9acb79181000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788837449.107281:0:13381:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb79181000 2 00000020:01000004:3.0:1788837449.107296:0:13381:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9acb79181000 from lustre-OST0001 00000020:00000080:3.0:1788837449.107345:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837449.107355:0:13381:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788837449.107358:0:13381:0:(genops.c:885:class_export_put()) final put ffff9acb48a12000/lustre-OST0001_UUID 00000020:00000080:3.0:1788837449.107361:0:13381:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb48a12000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788837449.107376:0:13381:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788837449.107489:0:13381:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 30a8965a-c42f-4c1b-a594-94749f11bd0b->MGS 00010000:00010000:3.0:1788837449.107503:0:13381:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3051b8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837449.107516:0:13381:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3051b8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837449.107523:0:13381:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788837449.107526:0:13381:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788837449.107529:0:13381:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788837449.107542:0:13381:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9acb46ab9800 00010000:00010000:3.0:1788837449.107546:0:13381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb40030c00/0x843cbef8be3051b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x843cbef8be3051b8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837449.107571:0:13381:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x843cbef8be3053f6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837449.107578:0:13381:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x843cbef8be3053f6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837449.107584:0:13381:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788837449.107586:0:13381:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788837449.107588:0:13381:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788837449.107597:0:13381:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9acb46ab9800 00010000:00010000:3.0:1788837449.107599:0:13381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb46aa5000/0x843cbef8be3053ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x843cbef8be3053f6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788837449.107626:0:13381:0:(import.c:65:import_set_state_nolock()) ffff9acb46ab9800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788837449.107630:0:13381:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788837449.107632:0:13381:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788837449.107633:0:13381:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788837449.107637:0:13381:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788837449.107647:0:13381:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9acb79047480 x1875731708725248/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788837456 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788837449.107664:0:13381:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788837449.107667:0:13381:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1788837449.107863:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30a8965a-c42f-4c1b-a594-94749f11bd0b:3312:1875731708725248:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:3.0:1788837449.108610:0:13381:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788837449.108621:0:13381:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be305092 00000020:00000080:3.0:1788837449.108626:0:13381:0:(genops.c:885:class_export_put()) final put ffff9acb46ac6000/30a8965a-c42f-4c1b-a594-94749f11bd0b 00000020:00000080:1.0:1788837449.108723:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb79003000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788837449.109062:0:13381:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.143@tcp (flags='') 00000020:00000080:3.0:1788837449.109068:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837449.109074:0:13381:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.143@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788837449.109079:0:13381:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9acb587319b8) has no exports 00000020:00000080:0.0:1788837449.109155:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb46ac6000/30a8965a-c42f-4c1b-a594-94749f11bd0b for MGC192.168.203.143@tcp 10000000:01000000:1.0:1788837449.109238:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788837449.109510:0:13381:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.143@tcp: client import never connected 00000100:00080000:3.0:1788837449.109515:0:13381:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788837449.109518:0:13381:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788837449.109520:0:13381:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788837449.109522:0:13381:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788837449.109682:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837449.109688:0:13381:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.143@tcp (uuid 30a8965a-c42f-4c1b-a594-94749f11bd0b) 00000020:01000000:3.0:1788837449.109693:0:13381:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788837449.109695:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837449.109698:0:13381:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788837449.109703:0:13381:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9acb79130800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837449.109708:0:13381:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9acb58734d28) has exports, disconnecting them 00000020:00080000:3.0:1788837449.109712:0:13381:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9acb79130800), last request at 1788837251 00000020:00000080:3.0:1788837449.109716:0:13381:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be3052c9 00000020:00080000:3.0:1788837449.109746:0:13381:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9acb79130800): rc 0 00000020:00000080:3.0:1788837449.109750:0:13381:0:(genops.c:885:class_export_put()) final put ffff9acb79130800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788837449.109772:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb46ab9800 for MGC192.168.203.143@tcp 00000020:00000080:0.0:1788837449.109778:0:8:0:(genops.c:885:class_export_put()) final put ffff9acb46abb000/30a8965a-c42f-4c1b-a594-94749f11bd0b 00000020:00000080:0.0:1788837449.109780:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb46abb000/30a8965a-c42f-4c1b-a594-94749f11bd0b for MGC192.168.203.143@tcp 00000020:01000000:0.0:1788837449.109785:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.143@tcp (30a8965a-c42f-4c1b-a594-94749f11bd0b) 00000020:00000080:0.0:1788837449.111024:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb79130800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788837449.131697:0:13381:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788837449.131707:0:13381:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837449.131711:0:13381:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788837449.131717:0:13381:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788837449.131854:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788837449.132094:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788837449.132333:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9acb6a75b800:5828] 1 exiting: rc = 0 00000020:00000080:0.0:1788837449.132642:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9acb7b458000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1788837449.132682:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9acb6a75aa00:5827] 0 exiting: rc = 1 00000100:00100000:3.0:1788837449.132780:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.133151:0:11669:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9acb74b81000:11669] 3 exiting: rc = 0 00000100:00100000:1.0:1788837449.133224:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9acb464c0a00:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1788837449.133426:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9acb464c1800:5831] 2 exiting: rc = 0 00000100:00100000:0.0:1788837449.133611:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9acb464c0800:5830] 1 exiting: rc = 0 00000100:00100000:3.0:1788837449.133691:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133699:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133705:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133710:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133715:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133721:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133726:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133747:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133753:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133759:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133765:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133771:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133777:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133784:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133790:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133798:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133804:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133809:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133814:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133819:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133825:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133831:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133836:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133841:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133846:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133851:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133856:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133876:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133881:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133886:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133904:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133908:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133913:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133918:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133923:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133928:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133933:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133938:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133943:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133948:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133952:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133957:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133961:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133966:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133971:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133975:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133981:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133985:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133989:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133994:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.133999:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134003:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134008:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134013:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134018:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134024:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134029:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134034:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134039:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134045:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134050:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134055:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134067:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.134072:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788837449.135237:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837449.135248:0:13381:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788837449.135253:0:13381:0:(genops.c:885:class_export_put()) final put ffff9acb6a779800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788837449.135257:0:13381:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb6a779800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788837449.135266:0:13381:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788837449.135330:0:13381:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb79181000 1 00000020:00000080:3.0:1788837449.135336:0:13381:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x843cbef8be30526e 00000020:00000080:3.0:1788837449.135342:0:13381:0:(genops.c:885:class_export_put()) final put ffff9acb6a77f800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788837449.135353:0:13381:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788837449.135358:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837449.135363:0:13381:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788837449.135367:0:13381:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9acb79064d28) has no exports 00000020:00000080:0.0:1788837449.136070:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb6a77f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788837449.159064:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837449.159079:0:13381:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788837449.159084:0:13381:0:(genops.c:885:class_export_put()) final put ffff9acb79182800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788837449.159088:0:13381:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb79182800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788837449.159095:0:13381:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788837449.159372:0:13381:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9acb79181800 00000020:01000000:1.0:1788837449.159391:0:13381:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788837449.159395:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837449.159399:0:13381:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788837449.159403:0:13381:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9acb7982b370) has no exports 00000020:00000080:1.0:1788837449.159434:0:13381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837449.159510:0:13381:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788837449.159514:0:13381:0:(genops.c:885:class_export_put()) final put ffff9acb44e3f800/OSS_uuid 00000020:00000080:1.0:1788837449.159517:0:13381:0:(genops.c:844:class_export_destroy()) destroying export ffff9acb44e3f800/OSS_uuid for OSS 00000020:01000000:1.0:1788837449.159523:0:13381:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788837449.159552:0:5840:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788837449.160080:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9acb45c0ec00:6700] 1 exiting: rc = 0 00000100:00100000:0.0:1788837449.161063:0:8306:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9acb7f6a1e00:8306] 3 exiting: rc = 0 00000100:00100000:0.0:1788837449.161130:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9acb45c0f600:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1788837449.161772:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9acb74845200:6701] 2 exiting: rc = 0 00000100:00100000:1.0:1788837449.163586:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163596:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163618:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163625:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163630:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163635:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163652:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163657:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163662:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163667:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163672:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163678:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163683:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163688:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163693:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163699:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163703:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163708:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163714:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163719:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163723:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163729:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163743:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163749:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163755:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163760:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163765:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163771:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163776:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163781:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163786:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163791:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163796:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163800:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163805:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163809:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163814:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163828:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163833:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163838:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163843:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163848:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163853:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163859:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163863:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163869:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163875:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163880:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163885:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163901:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163907:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163912:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163917:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163922:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163927:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163933:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163937:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163942:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163947:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163951:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163955:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163960:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163965:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.163969:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.165574:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9acb6a7fdc00:6702] 0 exiting: rc = 1 00000100:00100000:3.0:1788837449.165883:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9acb74845800:6703] 1 exiting: rc = 0 00000100:00100000:0.0:1788837449.166040:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166049:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166054:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166059:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166065:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166084:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166089:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166095:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166100:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166106:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166111:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166117:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166122:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166128:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166132:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166148:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166155:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166160:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166166:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166171:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166177:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166182:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166188:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166193:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166198:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166203:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166208:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166213:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166220:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166226:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166230:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166235:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166239:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166244:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166249:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166254:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166260:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166265:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166269:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166274:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166286:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166291:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166327:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166335:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166340:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166345:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166350:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166355:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166360:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166365:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166370:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166375:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166380:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166385:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166389:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166394:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166400:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166406:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166411:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166415:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166420:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166425:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166430:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.166435:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.168109:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9acb45399e00:6704] 0 exiting: rc = 1 00000100:00100000:0.0:1788837449.168848:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9acb46a64800:6706] 2 exiting: rc = 0 00000100:00100000:0.0:1788837449.169121:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9acb6a616000:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1788837449.169237:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169245:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169251:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169256:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169263:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169269:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169275:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169294:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169299:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169331:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169338:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169343:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169348:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169353:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169359:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169377:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169384:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169389:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169394:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169399:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169405:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169410:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169415:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169421:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169425:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169430:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169435:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169450:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169456:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169462:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169468:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169473:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169478:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169483:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169488:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169494:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169498:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169505:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169510:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169529:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169536:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169542:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169555:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169560:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169565:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169570:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169575:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169580:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169585:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169590:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169595:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169600:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169606:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169611:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169616:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169622:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169627:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169632:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169638:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169816:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169822:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169828:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169833:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837449.169838:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.177634:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9acb45c08600:6708] 1 exiting: rc = 0 00000100:00100000:3.0:1788837449.177746:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9acb46a64400:6707] 0 exiting: rc = 1 00000100:00100000:0.0:1788837449.177887:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.177960:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.177965:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.177971:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.177976:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.177982:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.177987:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178004:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178009:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178014:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178019:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178024:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178029:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178033:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178038:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178043:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178049:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178054:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178059:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178065:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178070:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178075:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178080:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178086:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178091:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178095:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178100:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178105:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178110:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178115:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178120:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178124:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178129:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178134:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178194:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178200:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178205:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178210:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178215:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178221:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178226:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178230:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178241:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178246:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178251:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178257:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178261:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178267:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178273:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178278:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178283:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178288:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178293:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178298:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178356:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178362:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178367:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178372:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178377:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178382:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178387:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178392:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178397:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.178402:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837449.179945:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9acb7b42f000:6709] 0 exiting: rc = 1 00000100:00100000:2.0:1788837449.180288:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9acb7b42fc00:6710] 1 exiting: rc = 0 00000100:00100000:0.0:1788837449.182929:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.182939:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.182946:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.182951:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.182958:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.182963:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.182977:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.182984:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.182990:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.182996:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183002:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183069:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183074:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183088:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183092:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183096:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183100:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183104:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183117:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183122:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183125:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183129:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183134:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183137:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183142:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183148:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183154:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183159:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183164:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183170:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183189:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183200:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183205:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183209:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183213:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183217:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183221:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183225:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183229:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183233:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183236:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183240:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183252:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183257:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183261:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183264:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183268:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183272:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183280:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183283:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183287:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183291:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183294:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183298:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183338:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183346:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183352:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183358:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183364:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183370:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183376:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183382:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.183391:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837449.184230:0:13381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788837449.197000:0:13381:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788837466.543215:0:13993:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788837476.495667:0:14454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788837476.495674:0:14454:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788837476.495788:0:14454:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9acb47ed0000 00000020:01000004:0.0:1788837476.495803:0:14454:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788837476.495812:0:14454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788837476.495826:0:14454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9acb7ade3370) 00000020:00000080:0.0:1788837476.495839:0:14454:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788837476.528256:0:14454:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788837476.530503:0:14454:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788837476.530925:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 371: rc = 0 00100000:10000000:2.0:1788837476.531027:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 371: rc = 0 00100000:10000000:2.0:1788837476.531125:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 371: rc = 0 00100000:10000000:2.0:1788837476.531225:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 371: rc = 0 00100000:10000000:2.0:1788837476.531429:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 371: rc = 0 00100000:10000000:2.0:1788837476.531705:0:14454:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788837476.531777:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 371: rc = 0 00100000:10000000:2.0:1788837476.532024:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 373: rc = 0 00100000:10000000:2.0:1788837476.533522:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 475: rc = 0 00100000:10000000:2.0:1788837476.533715:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 475: rc = 0 00100000:10000000:2.0:1788837476.534211:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1788837476.538957:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 768: rc = 0 00100000:10000000:2.0:1788837476.539247:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1788837476.539893:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1788837476.542614:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1788837476.542922:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1788837476.543182:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1788837476.543485:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 768: rc = 0 00100000:10000000:2.0:1788837476.543761:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 768: rc = 0 00100000:10000000:2.0:1788837476.544010:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1788837476.544266:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1788837476.548731:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1788837476.549423:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 651: rc = 0 00100000:10000000:2.0:1788837476.551042:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 651: rc = 0 00100000:10000000:2.0:1788837476.552689:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 651: rc = 0 00100000:10000000:2.0:1788837476.553032:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 651: rc = 0 00100000:10000000:2.0:1788837476.553252:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 651: rc = 0 00100000:10000000:2.0:1788837476.553530:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 651: rc = 0 00100000:10000000:2.0:1788837476.554449:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 651: rc = 0 00100000:10000000:2.0:1788837476.554909:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 651: rc = 0 00100000:10000000:2.0:1788837476.555177:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 651: rc = 0 00100000:10000000:2.0:1788837476.555884:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 651: rc = 0 00100000:10000000:2.0:1788837476.556139:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 651: rc = 0 00100000:10000000:2.0:1788837476.556451:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 651: rc = 0 00100000:10000000:2.0:1788837476.556841:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 651: rc = 0 00100000:10000000:2.0:1788837476.557100:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 651: rc = 0 00100000:10000000:2.0:1788837476.557397:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 651: rc = 0 00100000:10000000:2.0:1788837476.557931:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 651: rc = 0 00100000:10000000:2.0:1788837476.558185:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 651: rc = 0 00100000:10000000:2.0:1788837476.558847:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 651: rc = 0 00100000:10000000:2.0:1788837476.559101:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 651: rc = 0 00100000:10000000:2.0:1788837476.560826:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 651: rc = 0 00100000:10000000:2.0:1788837476.561233:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 651: rc = 0 00100000:10000000:2.0:1788837476.562986:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 651: rc = 0 00100000:10000000:2.0:1788837476.563267:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 651: rc = 0 00100000:10000000:2.0:1788837476.564197:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 651: rc = 0 00100000:10000000:2.0:1788837476.564837:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 651: rc = 0 00100000:10000000:2.0:1788837476.565101:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 651: rc = 0 00100000:10000000:2.0:1788837476.565424:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 651: rc = 0 00100000:10000000:2.0:1788837476.566142:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 651: rc = 0 00100000:10000000:2.0:1788837476.566674:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 651: rc = 0 00100000:10000000:2.0:1788837476.566942:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 651: rc = 0 00100000:10000000:2.0:1788837476.567182:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 651: rc = 0 00100000:10000000:2.0:1788837476.568683:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 651: rc = 0 00100000:10000000:2.0:1788837476.569096:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 527: rc = 0 00100000:10000000:2.0:1788837476.569676:0:14454:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788837476.569864:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 522: rc = 0 00100000:10000000:2.0:1788837476.570054:0:14454:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788837476.570121:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 522: rc = 0 00100000:10000000:2.0:1788837476.570333:0:14454:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788837476.570403:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 522: rc = 0 00100000:10000000:2.0:1788837476.575821:0:14454:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788837476.576013:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 476: rc = 0 00100000:10000000:2.0:1788837476.576236:0:14454:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788837476.576300:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 476: rc = 0 00100000:10000000:2.0:1788837476.577955:0:14454:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788837476.578051:0:14454:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 476: rc = 0 00000020:00000080:2.0:1788837476.579786:0:14454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788837476.579800:0:14454:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788837476.592787:0:14454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be306393 00000020:01000004:3.0:1788837476.592805:0:14454:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788837476.592811:0:14454:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788837476.592819:0:14454:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9acb47ed0000 from MGS 00000020:01000004:3.0:1788837476.592824:0:14454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788837476.592838:0:14454:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9acb58734d28) 00000020:00000080:3.0:1788837476.592851:0:14454:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788837476.592917:0:14454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb47ed0000 from MGS, refs=2 00080000:01000000:3.0:1788837476.592924:0:14454:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788837476.592929:0:14454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be3063a1 00000100:00100000:3.0:1788837476.593056:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788837476.593216:0:14454:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788837476.593222:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788837476.594011:0:14454:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788837476.594020:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788837476.597153:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837476.597422:0:14454:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788837476.597428:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788837476.598185:0:14454:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788837476.598193:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788837476.598750:0:14454:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788837476.598758:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788837476.600871:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837476.600876:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837476.600878:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837476.613087:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837476.613093:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837476.613096:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837476.613895:0:14454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788837476.622521:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788837476.627048:0:14454:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788837476.627068:0:14454:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788837476.627071:0:14454:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788837476.629229:0:14463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788837476.629448:0:14454:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788837476.629633:0:14454:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788837476.630070:0:14454:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788837476.630423:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837476.630885:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788837476.630891:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788837476.641360:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788837476.641389:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788837476.647237:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788837476.647337:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788837476.648856:0:14454:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788837476.648879:0:14454:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.143@tcp' 00000020:01000004:3.0:1788837476.648882:0:14454:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788837476.648912:0:14454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.143@tcp (typ=mgc) 00000020:00000080:3.0:1788837476.648926:0:14454:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.143@tcp (ffff9acb58733370) 00000020:00000080:3.0:1788837476.648941:0:14454:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788837476.649012:0:14454:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb469d7800@MGC192.168.203.143@tcp: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1788837476.649154:0:14454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.143@tcp-0 is initialized 00000040:01000000:3.0:1788837476.649161:0:14454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788837476.650982:0:14468:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788837476.653825:0:14470:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788837476.654961:0:14454:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.143@tcp (uuid c1fbef8f-8952-49e4-a88d-774a3e8128a4) 00000020:00000080:1.0:1788837476.654991:0:14454:0:(genops.c:1385:class_connect()) connect: client c1fbef8f-8952-49e4-a88d-774a3e8128a4, cookie 0x843cbef8be3063af 00000100:00080000:1.0:1788837476.655005:0:14454:0:(import.c:510:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788837476.655012:0:14454:0:(import.c:624:import_select_connection()) MGC192.168.203.143@tcp: import ffff9acb469d7800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1788837476.655044:0:14454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb48b8c380 x1875731708725376/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837476.655096:0:14454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c1fbef8f-8952-49e4-a88d-774a3e8128a4->MGS 00000020:01000004:1.0:1788837476.655123:0:14454:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788837476.655128:0:14454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788837476.655141:0:14454:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9acb5d353370) 00000020:00000080:1.0:1788837476.655152:0:14454:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788837476.656488:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3312:1875731708725376:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788837476.656568:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837476.656746:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708725376 00000100:00100000:2.0:1788837476.656755:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708725376 00000100:00100000:1.0:1788837476.668117:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837476.668372:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788837476.668379:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788837476.669791:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837476.669806:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7accd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3312:x1875731708725376:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788837476.669835:0:14466:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c1fbef8f-8952-49e4-a88d-774a3e8128a4@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:0.0:1788837476.669871:0:14466:0:(genops.c:1385:class_connect()) connect: client c1fbef8f-8952-49e4-a88d-774a3e8128a4, cookie 0x843cbef8be3063bd 00000100:00080000:0.0:1788837476.670004:0:14466:0:(import.c:65:import_set_state_nolock()) ffff9acb74622800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837476.670098:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7accd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+5:3312:x1875731708725376:12345-0@lo:250:mount.lustre.0 Request processed in 294us (13529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837476.670107:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837476.670157:0:3312:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788837476.670166:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.143@tcp: connect to target with instance 0 00000100:00080000:0.0:1788837476.670175:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788837476.670179:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788837476.670182:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb469d7800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788837476.670184:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788837476.670194:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788837476.670199:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3312:1875731708725376:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788837476.670908:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788837476.670918:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788837476.679032:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788837476.679045:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788837476.680740:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837476.681049:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788837476.681055:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788837476.682242:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788837476.682250:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788837476.717150:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837476.717595:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788837476.717602:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788837476.718873:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788837476.718884:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788837476.719510:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837476.719716:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788837476.719722:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788837476.720195:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788837476.720201:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788837476.720741:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837476.720902:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788837476.720907:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788837476.725657:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788837476.725680:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788837476.726514:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837476.726734:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788837476.726740:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788837476.733204:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788837476.733226:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788837476.762487:0:14454:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837476.762723:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788837476.762730:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788837476.764045:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788837476.764055:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788837476.764857:0:14454:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788837476.764867:0:14454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788837476.769767:0:14454:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788837476.769791:0:14454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788837476.769797:0:14454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788837476.769938:0:14454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788837476.769977:0:14454:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788837476.769982:0:14454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788837476.769983:0:14454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837476.769985:0:14454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837476.769986:0:14454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837476.769987:0:14454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837476.769988:0:14454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837476.769990:0:14454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837476.769991:0:14454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837476.769993:0:14454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837476.769995:0:14454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837476.769997:0:14454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788837476.769999:0:14454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837476.770000:0:14454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837476.770006:0:14454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837476.770007:0:14454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837476.770008:0:14454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837476.770009:0:14454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837476.770010:0:14454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837476.770011:0:14454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837476.770011:0:14454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837476.770012:0:14454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837476.770047:0:14454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788837476.770069:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708725504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788837476.770145:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.770196:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837476.770272:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708725504 00000100:00100000:1.0:1788837476.770281:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708725504 00000100:00100000:1.0:1788837476.770362:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837476.770372:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7acce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+5:14454:x1875731708725504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788837476.770407:0:14467:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788837476.770410:0:14467:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788837476.770413:0:14467:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788837476.772883:0:14488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788837476.773281:0:14467:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788837476.781920:0:14489:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788837476.781930:0:14489:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788837476.781933:0:14489:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788837476.781967:0:14489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788837476.784890:0:14467:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788837476.784906:0:14467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788837476.805854:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7acce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+5:14454:x1875731708725504:12345-0@lo:253:mount.lustre.0 Request processed in 35471us (35697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837476.805869:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837476.805964:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708725504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788837476.805979:0:14454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788837476.805982:0:14454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837476.805984:0:14454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837476.805986:0:14454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837476.805987:0:14454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837476.805988:0:14454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837476.805989:0:14454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837476.805991:0:14454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837476.805992:0:14454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837476.805994:0:14454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837476.805995:0:14454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788837476.806010:0:14454:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9acb47ed0000 from lustre-MDT0000 10000000:01000000:0.0:1788837476.806035:0:14454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788837476.806038:0:14454:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788837476.806042:0:14454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9acb58733370 10000000:01000000:0.0:1788837476.806047:0:14454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837476.806054:0:14454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9acb58733370 from 1 10000000:01000000:0.0:1788837476.806057:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788837476.806094:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.806120:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.806130:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837476.806149:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708725632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837476.806186:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.806286:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837476.810490:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708725632 00000100:00100000:3.0:1788837476.810507:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708725632 00000100:00100000:3.0:1788837476.810584:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837476.810596:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7accd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+5:14454:x1875731708725632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837476.810615:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837476.810638:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75237400/0x843cbef8be3063cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3063c4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.810670:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75237400/0x843cbef8be3063cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3063c4 expref: 6 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.810681:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75237400/0x843cbef8be3063cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3063c4 expref: 6 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.810690:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237400, rc 0) 00000100:00100000:3.0:1788837476.810780:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7accd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+6:14454:x1875731708725632:12345-0@lo:101:mount.lustre.0 Request processed in 187us (4593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837476.810786:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837476.810955:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708725632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837476.810976:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837476.810985:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837476.811052:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708725760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837476.811086:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837476.811124:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb44fe7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837476.811178:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708725760 00000100:00100000:2.0:1788837476.811183:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708725760 00000100:00100000:2.0:1788837476.811219:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837476.811227:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+6:14454:x1875731708725760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837476.811496:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+6:14454:x1875731708725760:12345-0@lo:501:mount.lustre.0 Request processed in 269us (408us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837476.811512:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837476.811696:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708725760:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788837476.811722:0:14454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788837476.811734:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.811742:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837476.811752:0:14454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9acb47ed0000 10000000:01000000:0.0:1788837476.811756:0:14454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788837476.811761:0:14454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9acb47ed0000 10000000:01000000:0.0:1788837476.811763:0:14454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788837476.811767:0:14454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9acb47ed0000 from 1 10000000:01000000:0.0:1788837476.811769:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788837476.811790:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a200/0x843cbef8be3063d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.811798:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917a200/0x843cbef8be3063d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.811819:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917a200/0x843cbef8be3063d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837476.811832:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708725888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837476.811861:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.811890:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837476.812051:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708725888 00000100:00100000:3.0:1788837476.812056:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708725888 00000100:00100000:3.0:1788837476.812092:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837476.812099:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+6:14454:x1875731708725888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837476.812108:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837476.812121:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75237e00/0x843cbef8be3063d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3063d2 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.812138:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75237e00/0x843cbef8be3063d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3063d2 expref: 7 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.812147:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75237e00/0x843cbef8be3063d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3063d2 expref: 7 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.812155:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237e00, rc 0) 00000100:00100000:3.0:1788837476.812192:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+7:14454:x1875731708725888:12345-0@lo:101:mount.lustre.0 Request processed in 93us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837476.812198:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837476.812340:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708725888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837476.812353:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917a200/0x843cbef8be3063d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063d9 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.812361:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917a200/0x843cbef8be3063d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3063d9 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837476.812375:0:14454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788837476.812390:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a200/0x843cbef8be3063d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063d9 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.812397:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917a200/0x843cbef8be3063d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063d9 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837476.812403:0:14454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788837476.812407:0:14454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837476.812411:0:14454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9acb47ed0000 10000000:01000000:0.0:1788837476.812418:0:14454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788837476.812421:0:14454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788837476.812423:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788837476.812438:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b000/0x843cbef8be3063e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.812452:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917b000/0x843cbef8be3063e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.812460:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917b000/0x843cbef8be3063e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837476.812473:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708726016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837476.812501:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.812518:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837476.812672:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708726016 00000100:00100000:1.0:1788837476.812677:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708726016 00000100:00100000:1.0:1788837476.812708:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837476.812715:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+7:14454:x1875731708726016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837476.812722:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837476.812734:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f577600/0x843cbef8be3063e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3063e0 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837476.812751:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577600/0x843cbef8be3063e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3063e0 expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837476.812759:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f577600/0x843cbef8be3063e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3063e0 expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837476.812773:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577600, rc 0) 00000100:00100000:1.0:1788837476.812802:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+8:14454:x1875731708726016:12345-0@lo:101:mount.lustre.0 Request processed in 87us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837476.812808:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837476.812935:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708726016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837476.812946:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917b000/0x843cbef8be3063e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063e7 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.812955:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917b000/0x843cbef8be3063e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3063e7 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837476.812998:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708726144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837476.813022:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.813050:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837476.813100:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708726144 00000100:00100000:2.0:1788837476.813105:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708726144 00000100:00100000:2.0:1788837476.813134:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837476.813142:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+8:14454:x1875731708726144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837476.813538:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+9:14454:x1875731708726144:12345-0@lo:501:mount.lustre.0 Request processed in 396us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837476.813545:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837476.813867:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708726144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837476.813903:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708726272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837476.813945:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.813965:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837476.814026:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708726272 00000100:00100000:3.0:1788837476.814032:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708726272 00000100:00100000:3.0:1788837476.814128:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837476.814138:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+9:14454:x1875731708726272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837476.814482:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+9:14454:x1875731708726272:12345-0@lo:503:mount.lustre.0 Request processed in 344us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837476.814489:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837476.817011:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708726272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837476.817441:0:14490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14490:1875731708726400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837476.817516:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.817547:0:14490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837476.821587:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708726400 00000100:00100000:1.0:1788837476.821605:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708726400 00000100:00100000:1.0:1788837476.821706:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837476.821717:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+9:14490:x1875731708726400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837476.822095:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+9:14490:x1875731708726400:12345-0@lo:502:llog_process_th.0 Request processed in 378us (4577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837476.822104:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837476.822390:0:14490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14490:1875731708726400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837476.822426:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837476.822437:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.822439:0:14490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788837476.822444:0:14490:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788837476.822447:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837476.822462:0:14490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9acb7ade0000) 00000020:00000080:0.0:1788837476.822479:0:14490:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788837476.822484:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788837476.822581:0:14490:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788837476.822589:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be3063f5 00000020:00000080:0.0:1788837476.822796:0:14490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788837476.822801:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837476.822804:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.822805:0:14490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788837476.822808:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837476.822811:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.822812:0:14490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788837476.822815:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837476.822822:0:14490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9acb7ade4d28) 00000020:00000080:0.0:1788837476.822831:0:14490:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788837476.822834:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788837476.822836:0:14490:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788837476.822838:0:14490:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788837476.822844:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788837476.822876:0:14490:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb47ed0000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788837476.822887:0:14490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9acb7ade19b8) 00000020:00000080:0.0:1788837476.822893:0:14490:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788837476.822936:0:14490:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788837476.822944:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be30640a 00000020:00000080:0.0:1788837476.823024:0:14490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788837476.823029:0:14490:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788837476.823033:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x843cbef8be306411 00080000:01000000:0.0:1788837476.823037:0:14490:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788837476.823040:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be306418 00010000:00010000:2.0:1788837476.910454:0:14490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788837476.913008:0:14490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788837476.913219:0:14490:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788837476.917831:0:14490:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9acb79063370) 00000020:00000080:2.0:1788837476.917858:0:14490:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788837476.917959:0:14490:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788837476.917965:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be306426 00000020:00000080:3.0:1788837476.924056:0:14490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788837476.927207:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x843cbef8be30642d 00000020:00000080:0.0:1788837476.930717:0:14490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788837476.930733:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837476.930741:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.930743:0:14490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788837476.930747:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788837476.930749:0:14490:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788837476.930751:0:14490:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837476.930752:0:14490:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837476.930753:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788837476.930756:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.930757:0:14490:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788837476.930759:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837476.930763:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.930765:0:14490:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788837476.930768:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788837476.930810:0:14490:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788837476.930823:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837476.930826:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.930828:0:14490:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788837476.930830:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788837476.930834:0:14490:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788837476.930837:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.930838:0:14490:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788837476.930841:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788837476.930847:0:14490:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:0.0:1788837476.930880:0:14490:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788837476.930883:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837476.930914:0:14490:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9acb44f43370) 00000020:00000080:0.0:1788837476.930931:0:14490:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788837476.930937:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788837476.930995:0:14490:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788837476.931002:0:14490:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788837476.931009:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be30643b 00010000:00080000:0.0:1788837476.931038:0:14490:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb79159000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1788837476.931285:0:14490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788837476.933016:0:14490:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788837476.933065:0:14490:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788837476.938296:0:14490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837476.938887:0:14490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788837476.938984:0:14490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788837476.943747:0:14494:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788837476.943756:0:14494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788837476.947190:0:14490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837476.947206:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788837476.947243:0:14490:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788837476.947262:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be306442 00000100:00080000:0.0:1788837476.947273:0:14490:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788837476.947279:0:14490:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9acb79159000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1788837476.947447:0:14490:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb74c7a680 x1875731708726528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837476.947593:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708726528:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788837476.947674:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875731708726528 offset 0 length 520: 4 00000100:00080000:0.0:1788837476.947752:0:14490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788837476.947816:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837476.947820:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.947822:0:14490:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788837476.947826:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788837476.947828:0:14490:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788837476.947830:0:14490:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837476.947831:0:14490:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837476.947833:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788837476.947835:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.947842:0:14490:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788837476.947847:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788837476.947851:0:14490:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788837476.947854:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.947856:0:14490:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788837476.947859:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788837476.947862:0:14490:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:0.0:1788837476.947886:0:14490:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788837476.947888:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837476.947902:0:14490:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9acb44f44d28) 00000020:00000080:0.0:1788837476.947915:0:14490:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788837476.947920:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788837476.947982:0:14490:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788837476.947989:0:14490:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788837476.948168:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x843cbef8be306450 00010000:00080000:0.0:1788837476.948215:0:14490:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb45cdb000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1788837476.948609:0:14490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788837476.948797:0:14490:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788837476.948821:0:14490:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788837476.949938:0:14490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837476.953803:0:14490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788837476.953969:0:14490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788837476.954817:0:14496:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788837476.954824:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788837476.963334:0:14490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788837476.963353:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788837476.963395:0:14490:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788837476.963418:0:14490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be306457 00000100:00080000:1.0:1788837476.963428:0:14490:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788837476.963434:0:14490:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9acb45cdb000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1788837476.963637:0:14490:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb48b8e680 x1875731708726656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837476.963716:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708726656:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788837476.963802:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875731708726656 offset 0 length 520: 4 00000100:00080000:1.0:1788837476.963865:0:14490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788837476.963928:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837476.963933:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837476.963935:0:14490:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788837476.963938:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837476.963942:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837476.963943:0:14490:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788837476.963946:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788837476.963954:0:14490:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788837476.963957:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837476.963960:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837476.963961:0:14490:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788837476.963963:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837476.963966:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837476.963967:0:14490:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788837476.963971:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788837476.964016:0:14490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14490:1875731708726784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837476.964068:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837476.964102:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708726784 00000100:00100000:1.0:1788837476.964109:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708726784 00000100:00100000:1.0:1788837476.964155:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837476.964165:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+9:14490:x1875731708726784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837476.964425:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+9:14490:x1875731708726784:12345-0@lo:502:llog_process_th.0 Request processed in 261us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837476.964434:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837476.964660:0:14490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42acf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837476.964682:0:14490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14490:1875731708726784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837476.964708:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837476.964712:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837476.964713:0:14490:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788837476.964716:0:14490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788837476.965146:0:14454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788837476.965164:0:14454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788837476.965222:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b000/0x843cbef8be3063e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063e7 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.965235:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917b000/0x843cbef8be3063e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063e7 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837476.965252:0:14454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9acb47ed0000 from 1 10000000:01000000:0.0:1788837476.965256:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837476.965285:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.965293:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.965331:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837476.965351:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708726912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837476.965390:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.965415:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837476.965775:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708726912 00000100:00100000:3.0:1788837476.965782:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708726912 00000100:00100000:3.0:1788837476.965823:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837476.965833:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+9:14454:x1875731708726912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837476.965846:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837476.965860:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30645e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.965884:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30645e expref: 10 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.965894:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30645e expref: 10 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.965902:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237800, rc 0) 00000100:00100000:3.0:1788837476.965941:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+10:14454:x1875731708726912:12345-0@lo:101:mount.lustre.0 Request processed in 110us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837476.965947:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837476.966113:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708726912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837476.966128:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.966138:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837476.966888:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727040:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788837476.966944:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.967066:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837476.967272:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708727040 00000100:00100000:1.0:1788837476.967278:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708727040 00000100:00100000:1.0:1788837476.967529:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837476.967539:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+10:14454:x1875731708727040:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788837476.967568:0:14466:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788837476.967575:0:14466:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788837476.967671:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+10:14454:x1875731708727040:12345-0@lo:256:mount.lustre.0 Request processed in 134us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837476.967679:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837476.967750:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727040:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788837476.968334:0:14454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837476.968369:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.968381:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837476.968390:0:14454:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb47ed0000 from 1 10000000:01000000:0.0:1788837476.968393:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837476.968427:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.968434:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.968444:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837476.968768:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837476.968824:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.969098:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837476.969179:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708727168 00000100:00100000:3.0:1788837476.969188:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708727168 00000100:00100000:3.0:1788837476.969226:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788837476.969235:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+10:14454:x1875731708727168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837476.969251:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837476.969269:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30646c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.969297:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30646c expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.969345:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30646c expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837476.969355:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237000, rc 0) 00000100:00100000:3.0:1788837476.969396:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14454:x1875731708727168:12345-0@lo:101:mount.lustre.0 Request processed in 162us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837476.969403:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837476.969581:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837476.969597:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837476.969605:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837476.969664:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837476.969694:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.969725:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837476.969771:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708727296 00000100:00100000:3.0:1788837476.969775:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708727296 00000100:00100000:3.0:1788837476.969793:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837476.969798:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14454:x1875731708727296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837476.970286:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14454:x1875731708727296:12345-0@lo:501:mount.lustre.0 Request processed in 485us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837476.970294:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837476.970587:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837476.970622:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837476.970666:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.970728:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f200a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837476.970763:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708727424 00000100:00100000:2.0:1788837476.970768:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708727424 00000100:00100000:3.0:1788837476.970813:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837476.970822:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14454:x1875731708727424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837476.970971:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14454:x1875731708727424:12345-0@lo:503:mount.lustre.0 Request processed in 150us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837476.970979:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837476.971198:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837476.971905:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14498:1875731708727552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837476.971954:0:14498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.972107:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d80b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837476.972177:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708727552 00000100:00100000:1.0:1788837476.972183:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708727552 00000100:00100000:1.0:1788837476.972212:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837476.972220:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14498:x1875731708727552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837476.972565:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14498:x1875731708727552:12345-0@lo:502:llog_process_th.0 Request processed in 345us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837476.972573:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837476.972666:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14498:1875731708727552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837476.972696:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837476.972705:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.972707:0:14498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788837476.972717:0:14498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb47ed0000 00000020:00000080:0.0:1788837476.972719:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837476.972727:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837476.972730:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.972731:0:14498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788837476.972734:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837476.972737:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.972738:0:14498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788837476.972742:0:14498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb47ed0000 00000020:00000080:0.0:1788837476.972744:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837476.972801:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837476.972805:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.972806:0:14498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788837476.972810:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837476.972812:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.972813:0:14498:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788837476.972825:0:14498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9acb47ed0000 00000020:00000080:0.0:1788837476.972827:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788837476.972865:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14498:1875731708727680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837476.972903:0:14498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837476.972925:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d80b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837476.975848:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708727680 00000100:00100000:1.0:1788837476.975868:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708727680 00000100:00100000:1.0:1788837476.975934:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837476.975944:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14498:x1875731708727680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837476.980040:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14498:x1875731708727680:12345-0@lo:502:llog_process_th.0 Request processed in 4086us (7124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837476.980056:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837476.991159:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14498:1875731708727680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837476.991217:0:14498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837476.991226:0:14498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837476.991228:0:14498:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788837476.991235:0:14498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788837476.994408:0:14454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788837476.994443:0:14454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837476.995427:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837476.995445:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837476.995604:0:14454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788837476.995607:0:14454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9acb47ed0000 10000000:01000000:2.0:1788837476.995610:0:14454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9acb47ed0000 10000000:01000000:2.0:1788837476.995614:0:14454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837476.995621:0:14454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb47ed0000 from 1 10000000:01000000:2.0:1788837476.995624:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837476.995661:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f543a00/0x843cbef8be30647a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837476.995669:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f543a00/0x843cbef8be30647a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837476.995680:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f543a00/0x843cbef8be30647a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837476.995703:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837476.995767:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837476.995852:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d839c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837477.007780:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708727808 00000100:00100000:1.0:1788837477.007798:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708727808 00000100:00100000:2.0:1788837477.015211:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837477.015226:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14454:x1875731708727808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837477.015245:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837477.015268:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f543000/0x843cbef8be306481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30647a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837477.015298:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f543000/0x843cbef8be306481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30647a expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837477.015369:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f543000/0x843cbef8be306481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30647a expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837477.015387:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543000, rc 0) 00000100:00100000:0.0:1788837477.018655:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837477.018687:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f543a00/0x843cbef8be30647a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306481 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.018702:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f543a00/0x843cbef8be30647a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be306481 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837477.018780:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837477.018835:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837477.018877:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837477.019103:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708727936 00000100:00100000:3.0:1788837477.019110:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708727936 00000100:00100000:3.0:1788837477.019200:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788837477.019210:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+13:14454:x1875731708727936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837477.019521:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+13:14454:x1875731708727936:12345-0@lo:501:mount.lustre.0 Request processed in 312us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837477.019539:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837477.019619:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14454:x1875731708727808:12345-0@lo:101:mount.lustre.0 Request processed in 4396us (23851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837477.019626:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837477.019702:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708727936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837477.019740:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708728064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837477.019779:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837477.019983:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837477.020103:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708728064 00000100:00100000:1.0:1788837477.020109:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708728064 00000100:00100000:1.0:1788837477.020139:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837477.020146:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14454:x1875731708728064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788837477.020374:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14454:x1875731708728064:12345-0@lo:503:mount.lustre.0 Request processed in 228us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837477.020381:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788837477.024762:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708728064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837477.025645:0:14504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14504:1875731708728192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837477.025721:0:14504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837477.025767:0:14504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46bb3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837477.025838:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708728192 00000100:00100000:0.0:1788837477.025851:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708728192 00000100:00100000:0.0:1788837477.025903:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788837477.025911:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14504:x1875731708728192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837477.026167:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14504:x1875731708728192:12345-0@lo:502:llog_process_th.0 Request processed in 256us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837477.026175:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837477.026520:0:14504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14504:1875731708728192:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788837477.026593:0:14504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788837477.026607:0:14504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9acb587319b8) 00000020:00000080:3.0:1788837477.026626:0:14504:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788837477.026711:0:14504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb47ed0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788837477.026715:0:14504:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9acb47ed0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788837477.026717:0:14504:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb47ed0000 4 00010000:00080000:3.0:1788837477.026741:0:14504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb58772000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1788837477.036785:0:14504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788837477.037064:0:14504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788837477.037105:0:14504:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788837477.037119:0:14504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x843cbef8be30648f 00000100:00080000:2.0:1788837477.037129:0:14504:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837477.037135:0:14504:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9acb58772000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1788837477.037169:0:14504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb79044a80 x1875731708728320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837477.037198:0:14504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788837477.037337:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708728320:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788837477.037402:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837477.037689:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708728320 00000100:00100000:1.0:1788837477.037703:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708728320 00000100:00100000:1.0:1788837477.037741:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837477.037748:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1875731708728320:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788837477.037804:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1875731708728320:12345-0@lo:38:llog_process_th.0 Request processed in 56us (401us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788837477.037812:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837477.038601:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837477.038611:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb58772000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837477.038617:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788837477.038621:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708728320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788837477.038798:0:14504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79045180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14504:1875731708728448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837477.038863:0:14504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837477.038890:0:14504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb50d83240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837477.039908:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708728448 00000100:00100000:1.0:1788837477.039919:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708728448 00000100:00100000:1.0:1788837477.039976:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837477.039986:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14504:x1875731708728448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837477.040247:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14504:x1875731708728448:12345-0@lo:502:llog_process_th.0 Request processed in 262us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837477.040255:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837477.040413:0:14504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79045180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14504:1875731708728448:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788837477.040449:0:14504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788837477.040664:0:14454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788837477.040681:0:14454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837477.040701:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f543a00/0x843cbef8be30647a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306481 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.040713:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f543a00/0x843cbef8be30647a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306481 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788837477.040761:0:14454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788837477.040763:0:14454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837477.040765:0:14454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837477.040766:0:14454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837477.040767:0:14454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837477.040768:0:14454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837477.040770:0:14454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837477.040771:0:14454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837477.040773:0:14454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837477.040775:0:14454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837477.040784:0:14454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788837477.040787:0:14454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837477.040788:0:14454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837477.040789:0:14454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837477.040790:0:14454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837477.040791:0:14454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837477.040792:0:14454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837477.040793:0:14454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837477.040794:0:14454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837477.040794:0:14454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837477.040795:0:14454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837477.040813:0:14454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788837477.040828:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708728576:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788837477.040877:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837477.040915:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837477.041380:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708728576 00000100:00100000:2.0:1788837477.041385:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708728576 00000100:00100000:2.0:1788837477.041418:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788837477.041427:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14454:x1875731708728576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788837477.041451:0:14464:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788837477.041535:0:14464:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788837477.104017:0:14464:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788837477.104066:0:14464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788837477.105817:0:14488:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788837477.105828:0:14488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788837477.105853:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.105871:0:14488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30645e expref: 12 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.105880:0:14488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.105920:0:14488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30645e expref: 12 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.105934:0:14488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30645e expref: 12 pid: 14464 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837477.105948:0:14488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14488:1875731708728704:0@lo:104: 00000100:00100000:0.0:1788837477.106013:0:14488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837477.106126:0:14488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837477.106633:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708728704 00000100:00100000:3.0:1788837477.106642:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708728704 00000100:00100000:3.0:1788837477.106791:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837477.106802:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:14488:x1875731708728704:12345-0@lo:104: 00010000:00010000:3.0:1788837477.106818:0:14455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837477.106881:0:14455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837477.106888:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:14488:x1875731708728704:12345-0@lo:104: Request processed in 88us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837477.106895:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837477.106915:0:14488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14488:1875731708728704:0@lo:104: 00010000:00010000:2.0:1788837477.106943:0:14488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.107009:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837477.107016:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.107024:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917aa00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837477.107029:0:14461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.107041:0:14461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837477.107047:0:14461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837477.107053:0:14461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837477.107127:0:14461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.107134:0:14461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837477.107165:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.107172:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7917aa00/0x843cbef8be30645e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306465 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.107189:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837477.107191:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837477.107193:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837477.109672:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3316:1875731708728832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837477.109750:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837477.110024:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708728832 00000100:00100000:0.0:1788837477.110033:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708728832 00010000:00010000:0.0:1788837477.110077:0:14457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30645e expref: 13 pid: 14464 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837477.110103:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837477.110112:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+13:3316:x1875731708728832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837477.110126:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837477.110132:0:14457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30645e expref: 13 pid: 14464 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110144:0:14457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30645e expref: 13 pid: 14464 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110162:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb75237800/0x843cbef8be306465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30645e expref: 13 pid: 14464 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110178:0:14457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110187:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788837477.110203:0:14457:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004375807s 00010000:00010000:0.0:1788837477.110207:0:14457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110214:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110221:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110228:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110241:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837477.110245:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110254:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110267:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837477.110276:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837477.110346:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:3316:x1875731708728832:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837477.110353:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837477.110397:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3316:1875731708728832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837477.110479:0:14488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837477.110487:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837477.110494:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7917a400/0x843cbef8be306496 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837477.111270:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14454:x1875731708728576:12345-0@lo:253:mount.lustre.0 Request processed in 69839us (70387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837477.111281:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837477.111631:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14454:1875731708728576:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788837477.111645:0:14454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788837477.111648:0:14454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837477.111649:0:14454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837477.111651:0:14454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837477.111652:0:14454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837477.111653:0:14454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837477.111654:0:14454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837477.111656:0:14454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837477.111658:0:14454:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837477.111659:0:14454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837477.111661:0:14454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788837477.111673:0:14454:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788837477.116916:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837477.117093:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837477.117531:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837477.117713:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837477.117979:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837477.118118:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837477.118904:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837477.119058:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837477.119734:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837477.119936:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837477.120190:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837477.120382:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788837477.147936:0:14454:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788837477.148352:0:14454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788837477.148592:0:14510:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788837477.148602:0:14510:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788837477.148783:0:14511:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788837477.148855:0:14511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788837477.151195:0:14454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788837477.151336:0:14454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788837477.153680:0:14454:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788837477.153702:0:14454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788837477.153977:0:14454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837477.154718:0:14511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788837477.154790:0:14511:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788837477.154794:0:14511:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788837477.155948:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788837477.156810:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788837477.156874:0:14454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788837477.158945:0:14454:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788837477.164082:0:14454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788837477.198814:0:14454:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788837477.198852:0:14454:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6b08151f988 00100000:10000000:3.0:1788837477.198861:0:14454:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788837477.199869:0:14454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788837477.199883:0:14454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788837477.199895:0:14454:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788837477.199910:0:14454:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788837477.670423:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788837477.733379:0:14470:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788837477.733386:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9acb47ed0000 from 6 10000000:01000000:1.0:1788837477.733390:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788837477.733442:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837477.733453:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837477.733464:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837477.733500:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708728960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837477.733573:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837477.733625:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837477.733675:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708728960 00000100:00100000:2.0:1788837477.733683:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708728960 00000100:00100000:2.0:1788837477.733737:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788837477.733747:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14470:x1875731708728960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837477.733760:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837477.733772:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30649d expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837477.733794:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30649d expref: 12 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837477.733805:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30649d expref: 12 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837477.733814:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543800, rc 0) 00000100:00100000:2.0:1788837477.733868:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14470:x1875731708728960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837477.733875:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837477.733975:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708728960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837477.734060:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837477.734072:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837477.734126:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708729088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788837477.734160:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837477.734184:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca41e123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837477.734366:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708729088 00000100:00100000:1.0:1788837477.734372:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708729088 00000100:00100000:1.0:1788837477.734402:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837477.734408:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14470:x1875731708729088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788837477.734421:0:14464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788837477.734442:0:14464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788837477.734445:0:14464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788837477.734517:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14470:x1875731708729088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837477.734524:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837477.735109:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708729088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788837477.735162:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788837477.735171:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837477.735181:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837478.057153:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788837478.693473:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837479.078168:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788837479.717443:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837480.744015:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837481.766619:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788837481.820916:0:14753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788837482.344963:0:12650:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837482.344970:0:12650:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788837482.344972:0:12650:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837482.344989:0:12650:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788837482.344991:0:12650:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788837482.344994:0:12650:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837482.344998:0:12650:0:(import.c:65:import_set_state_nolock()) ffff9acb58772000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837482.345012:0:12650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9acb58772000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1788837482.345039:0:12650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb79633800 x1875731708729344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837482.345880:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3313:1875731708729216:0@lo:400:kworker.0 00000100:00100000:3.0:1788837482.345999:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837482.346062:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708729344:0@lo:38:kworker.0 00000100:00100000:3.0:1788837482.346095:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837482.346128:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708729216 00000100:00100000:3.0:1788837482.346135:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708729216 00000100:00100000:3.0:1788837482.346177:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837482.346185:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:3313:x1875731708729216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837482.346235:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:3313:x1875731708729216:12345-0@lo:400:kworker.0 Request processed in 51us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837482.346243:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837482.346294:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3313:1875731708729216:0@lo:400:kworker.0 00000100:00100000:3.0:1788837482.346361:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708729344 00000100:00100000:3.0:1788837482.346365:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708729344 00000100:00100000:3.0:1788837482.346384:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837482.346389:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875731708729344:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788837482.349193:0:14474:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1788837482.349263:0:14474:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x843cbef8be3064ab 00000004:00100000:3.0:1788837482.349282:0:14474:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788837482.349797:0:14474:0:(import.c:65:import_set_state_nolock()) ffff9acb45de3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837482.349893:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875731708729344:12345-0@lo:38:kworker.0 Request processed in 3501us (3794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837482.349905:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788837482.350915:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9acb79633800 x1875731708729344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837482.350937:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788837482.350947:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788837482.350952:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788837482.350956:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb58772000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788837482.350965:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875731708729344:0@lo:38:kworker.0 00010000:00010000:0.0:1788837482.790404:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837483.813521:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788837484.648893:0:14905:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd787b290 20000000:00000080:2.0:1788837484.648912:0:14905:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9acb73b9f400 uarg=0000000000000000 20000000:01000000:2.0:1788837484.648956:0:14905:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788837484.648964:0:14905:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788837484.649037:0:14905:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788837484.652701:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788837484.653258:0:14905:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788837484.659554:0:14905:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788837484.659588:0:14905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837484.659608:0:14905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30646c expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837484.659617:0:14905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837484.659663:0:14905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30646c expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837484.659700:0:14905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30646c expref: 11 pid: 14464 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837484.659716:0:14905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14905:1875731708729472:0@lo:104: 00000100:00100000:3.0:1788837484.659786:0:14905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837484.659853:0:14905:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837484.660421:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708729472 00000100:00100000:1.0:1788837484.660429:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708729472 00000100:00100000:1.0:1788837484.660478:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837484.660488:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:14905:x1875731708729472:12345-0@lo:104: 00010000:00010000:1.0:1788837484.660512:0:14456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837484.660580:0:14456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837484.660587:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:14905:x1875731708729472:12345-0@lo:104: Request processed in 100us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837484.660594:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788837484.660715:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837484.660723:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.660732:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b400 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837484.660736:0:14461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.660745:0:14461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837484.660753:0:14461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837484.660760:0:14461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837484.660800:0:14461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.660808:0:14461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837484.660836:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.660842:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7917b400/0x843cbef8be30646c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306473 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.660857:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837484.660859:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837484.660860:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837484.660937:0:14905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14905:1875731708729472:0@lo:104: 00010000:00010000:2.0:1788837484.660960:0:14905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837484.661120:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708729600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837484.661161:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837484.661246:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708729600 00000100:00100000:0.0:1788837484.661251:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708729600 00010000:00010000:0.0:1788837484.661279:0:14457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30646c expref: 12 pid: 14464 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837484.661327:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837484.661336:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:3314:x1875731708729600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837484.661348:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837484.661353:0:14457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30646c expref: 12 pid: 14464 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661364:0:14457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30646c expref: 12 pid: 14464 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661378:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb75237000/0x843cbef8be306473 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30646c expref: 12 pid: 14464 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661390:0:14457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661398:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661438:0:14457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661445:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661451:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661457:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661462:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237600 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837484.661466:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661473:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661485:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837484.661504:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837484.661539:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:3314:x1875731708729600:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837484.661546:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788837484.661905:0:14905:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837484.661914:0:14905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837484.661920:0:14905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb75237600/0x843cbef8be3064b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837484.662691:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708729600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837484.841250:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837485.865228:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788837486.311341:0:14470:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837486.311349:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb47ed0000 from 10 10000000:01000000:3.0:1788837486.311355:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837486.311398:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837486.311411:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837486.311421:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837486.311444:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708729728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837486.311529:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837486.311591:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837486.311714:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708729728 00000100:00100000:1.0:1788837486.311730:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708729728 00000100:00100000:1.0:1788837486.311783:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837486.311794:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+11:14470:x1875731708729728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837486.311807:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837486.311821:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3064b9 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837486.311842:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3064b9 expref: 12 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837486.311853:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3064b9 expref: 12 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837486.311862:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577400, rc 0) 00000100:00100000:1.0:1788837486.311907:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14470:x1875731708729728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837486.311914:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837486.311960:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708729728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837486.311974:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837486.311983:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837486.312035:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708729856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837486.312059:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837486.312080:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837486.312090:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708729856 00000100:00100000:1.0:1788837486.312099:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708729856 00000100:00100000:1.0:1788837486.312118:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837486.312123:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14470:x1875731708729856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837486.312354:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14470:x1875731708729856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837486.312361:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837486.312387:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708729856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837486.312410:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708729984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837486.312442:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837486.312453:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837486.312462:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708729984 00000100:00100000:1.0:1788837486.312465:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708729984 00000100:00100000:1.0:1788837486.312510:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837486.312516:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14470:x1875731708729984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837486.312639:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:14470:x1875731708729984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837486.312646:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837486.312678:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708729984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788837486.313393:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788837486.313435:0:14470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788837486.313449:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837486.313457:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837486.313467:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837486.441273:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837476/real 1788837476] req@ffff9acb48b8e680 x1875731708726656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837486 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837486.441345:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9acb48b8e680 x1875731708726656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837486 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837486.441355:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837476/real 1788837476] req@ffff9acb74c7a680 x1875731708726528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837486 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837486.441365:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9acb74c7a680 x1875731708726528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837486 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788837486.441381:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb45cdb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837486.441407:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788837486.441411:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708726656:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788837486.441417:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb79159000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837486.441422:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788837486.441425:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708726528:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788837486.442147:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837486.442153:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788837486.442157:0:8:0:(import.c:65:import_set_state_nolock()) ffff9acb79159000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837486.442169:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1788837486.442174:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788837486.442180:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9acb79159000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1788837486.442211:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb79633100 x1875731708730112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837486.442231:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837486.442234:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788837486.442236:0:8:0:(import.c:65:import_set_state_nolock()) ffff9acb45cdb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837486.442239:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1788837486.442241:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788837486.442244:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9acb45cdb000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1788837486.442254:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb79632a00 x1875731708730240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837486.442321:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708730368:0@lo:400:kworker.0 00000100:00100000:3.0:1788837486.442387:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837486.442612:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708730368 00000100:00100000:3.0:1788837486.442621:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708730368 00000100:00100000:3.0:1788837486.442663:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837486.442673:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708730368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837486.442724:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708730368:12345-0@lo:400:kworker.0 Request processed in 52us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837486.442731:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788837486.442770:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9acb79631180 x1875731708730368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837486.442782:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708730368:0@lo:400:kworker.0 00000100:00100000:3.0:1788837486.442812:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708730112:0@lo:8:kworker.0 00000400:00000100:3.0:1788837486.442835:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875731708730112 offset 0 length 520: 4 00000100:00100000:3.0:1788837486.442855:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708730240:0@lo:8:kworker.0 00000400:00000100:3.0:1788837486.446020:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875731708730240 offset 0 length 520: 4 00010000:00010000:3.0:1788837486.885590:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837487.913748:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837488.936264:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788837489.317976:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788837489.833617:0:15154:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788837489.833621:0:15154:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788837489.833798:0:15154:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9acb45de4800 00000020:01000004:3.0:1788837489.833812:0:15154:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788837489.833825:0:15154:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788837489.833839:0:15154:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9acb58730000) 00000020:00000080:3.0:1788837489.833854:0:15154:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788837489.863995:0:15154:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788837489.866531:0:15154:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788837489.867999:0:15154:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788837489.868223:0:15154:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788837489.869020:0:15154:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788837489.869660:0:15154:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 485: rc = 0 00100000:10000000:2.0:1788837489.870015:0:15154:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 485: rc = 0 00100000:10000000:2.0:1788837489.870113:0:15154:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 485: rc = 0 00100000:10000000:2.0:1788837489.870575:0:15154:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 298: rc = 0 00100000:10000000:2.0:1788837489.870957:0:15154:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 298: rc = 0 00100000:10000000:2.0:1788837489.871204:0:15154:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 298: rc = 0 00100000:10000000:2.0:1788837489.871781:0:15154:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 298: rc = 0 00100000:10000000:2.0:1788837489.872039:0:15154:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 298: rc = 0 00100000:10000000:2.0:1788837489.872264:0:15154:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 298: rc = 0 00000020:00000080:2.0:1788837489.873137:0:15154:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788837489.873150:0:15154:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788837489.873163:0:15154:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x843cbef8be3064ce 00000020:01000004:2.0:1788837489.873171:0:15154:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788837489.873193:0:15154:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788837489.873197:0:15154:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788837489.873202:0:15154:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788837489.873207:0:15154:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788837489.873219:0:15154:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9acb790619b8) 00000020:00000080:2.0:1788837489.873229:0:15154:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788837489.874897:0:15154:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837489.875087:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788837489.875093:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788837489.881229:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788837489.881243:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788837489.885156:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788837489.885169:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788837489.886984:0:15154:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837489.887196:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788837489.887202:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788837489.891937:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788837489.891950:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788837489.933868:0:15154:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837489.934113:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788837489.934120:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788837489.938271:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788837489.938285:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788837489.939619:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788837489.939629:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788837489.942358:0:15154:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837489.942767:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788837489.942775:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788837489.944111:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788837489.944122:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1788837489.959607:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837489.985009:0:15154:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837489.985245:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788837489.985251:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788837489.991750:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788837489.991768:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788837489.992630:0:15154:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788837489.992660:0:15154:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788837489.992668:0:15154:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788837490.008943:0:15154:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788837490.008995:0:15154:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788837490.009001:0:15154:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788837490.009003:0:15154:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837490.009004:0:15154:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837490.009005:0:15154:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837490.009006:0:15154:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837490.009008:0:15154:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837490.009009:0:15154:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837490.009011:0:15154:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837490.009013:0:15154:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788837490.009016:0:15154:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788837490.009018:0:15154:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788837490.009025:0:15154:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837490.009026:0:15154:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837490.009027:0:15154:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837490.009028:0:15154:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837490.009029:0:15154:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837490.009030:0:15154:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837490.009031:0:15154:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837490.009032:0:15154:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788837490.009059:0:15154:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788837490.009082:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79045180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708730496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788837490.009169:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837490.009551:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46bb3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837490.009636:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708730496 00000100:00100000:1.0:1788837490.009643:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708730496 00000100:00100000:1.0:1788837490.009730:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837490.009740:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46952c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:15154:x1875731708730496:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788837490.009770:0:14464:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788837490.009773:0:14464:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788837490.009777:0:14464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788837490.018354:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46952c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:15154:x1875731708730496:12345-0@lo:253:mount.lustre.0 Request processed in 8558us (9127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837490.018588:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79045180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708730496:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788837490.018603:0:15154:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788837490.018607:0:15154:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837490.018609:0:15154:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837490.018610:0:15154:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837490.018611:0:15154:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837490.018613:0:15154:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837490.018614:0:15154:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837490.018616:0:15154:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837490.018618:0:15154:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837490.018619:0:15154:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788837490.018638:0:15154:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9acb45de4800 from lustre-OST0000 10000000:01000000:2.0:1788837490.018687:0:15154:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788837490.018690:0:15154:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788837490.018696:0:15154:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9acb58733370 local copy 00010000:00010000:2.0:1788837490.018706:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837490.018929:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79045180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708730624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837490.018969:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837490.019009:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837490.019056:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837490.019596:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708730624 00000100:00100000:3.0:1788837490.019603:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708730624 00000100:00100000:3.0:1788837490.019696:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837490.019704:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:15154:x1875731708730624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837490.019892:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:15154:x1875731708730624:12345-0@lo:501:mount.lustre.0 Request processed in 188us (922us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837490.019900:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788837490.019979:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79045180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708730624:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788837490.019997:0:15154:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788837490.020154:0:15154:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788837490.020161:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837490.020171:0:15154:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837490.020201:0:15154:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9acb45de4800 10000000:01000000:1.0:1788837490.020206:0:15154:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788837490.020211:0:15154:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9acb58733370 10000000:01000000:1.0:1788837490.020214:0:15154:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788837490.020217:0:15154:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9acb58733370 from 1 10000000:01000000:1.0:1788837490.020220:0:15154:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788837490.020248:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f577e00/0x843cbef8be3064dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837490.020257:0:15154:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f577e00/0x843cbef8be3064dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837490.020265:0:15154:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f577e00/0x843cbef8be3064dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837490.020282:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708730752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788837490.020360:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.020818:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aca4186b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788837490.020855:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708730752 00000100:00100000:2.0:1788837490.020868:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708730752 00000100:00100000:2.0:1788837490.020896:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788837490.020905:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+12:15154:x1875731708730752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837490.020915:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837490.020928:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f543200/0x843cbef8be3064e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3064dc expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837490.020949:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f543200/0x843cbef8be3064e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3064dc expref: 13 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837490.020959:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f543200/0x843cbef8be3064e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3064dc expref: 13 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837490.020968:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543200, rc 0) 00000100:00100000:2.0:1788837490.021054:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+13:15154:x1875731708730752:12345-0@lo:101:mount.lustre.0 Request processed in 150us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837490.021061:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837490.021173:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708730752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837490.021187:0:15154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f577e00/0x843cbef8be3064dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064e3 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.021197:0:15154:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f577e00/0x843cbef8be3064dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3064e3 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837490.021217:0:15154:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788837490.021273:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f577e00/0x843cbef8be3064dc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064e3 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.021293:0:15154:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f577e00/0x843cbef8be3064dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064e3 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837490.021300:0:15154:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788837490.021502:0:15154:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837490.021508:0:15154:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788837490.021510:0:15154:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788837490.021532:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b600/0x843cbef8be3064ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.021541:0:15154:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917b600/0x843cbef8be3064ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.021548:0:15154:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917b600/0x843cbef8be3064ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837490.021564:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708730880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837490.021597:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.021622:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb791693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837490.021705:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708730880 00000100:00100000:2.0:1788837490.021711:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708730880 00000100:00100000:2.0:1788837490.022143:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788837490.022152:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+13:15154:x1875731708730880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837490.022163:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837490.022174:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f542a00/0x843cbef8be3064f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3064ea expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837490.022192:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f542a00/0x843cbef8be3064f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3064ea expref: 14 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837490.022201:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f542a00/0x843cbef8be3064f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3064ea expref: 14 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837490.022219:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542a00, rc 0) 00000100:00100000:2.0:1788837490.022264:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708730880:12345-0@lo:101:mount.lustre.0 Request processed in 114us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837490.022271:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788837490.022356:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708730880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837490.022378:0:15154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917b600/0x843cbef8be3064ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064f1 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.022386:0:15154:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917b600/0x843cbef8be3064ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3064f1 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837490.023058:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788837490.023963:0:15154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837490.024215:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788837490.024257:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788837490.024370:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788837490.024419:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788837490.024453:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788837490.024504:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788837490.024572:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788837490.024581:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788837490.024670:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837490.024741:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.025512:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79169f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837490.025560:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708731008 00000100:00100000:3.0:1788837490.025567:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708731008 00000100:00100000:3.0:1788837490.025608:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788837490.025618:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708731008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837490.026193:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708731008:12345-0@lo:501:mount.lustre.0 Request processed in 574us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837490.026203:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788837490.026291:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837490.028530:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837490.028636:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.028676:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79169f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837490.028761:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708731136 00000100:00100000:3.0:1788837490.028769:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708731136 00000100:00100000:3.0:1788837490.028819:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788837490.028828:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708731136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837490.029164:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708731136:12345-0@lo:503:mount.lustre.0 Request processed in 336us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837490.029171:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788837490.029346:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788837490.030116:0:15154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837490.030202:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837490.030256:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.030282:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79169f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837490.031050:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708731264 00000100:00100000:3.0:1788837490.031059:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708731264 00000100:00100000:3.0:1788837490.031107:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788837490.031117:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708731264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837490.031691:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708731264:12345-0@lo:502:mount.lustre.0 Request processed in 573us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837490.031700:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837490.031918:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837490.035318:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788837490.035432:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788837490.035481:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788837490.035535:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788837490.035572:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788837490.035603:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788837490.035653:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788837490.035690:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788837490.035732:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788837490.035796:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788837490.035833:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788837490.035881:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788837490.035934:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837490.036011:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.036117:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79169c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837490.036329:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708731392 00000100:00100000:1.0:1788837490.036337:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708731392 00000100:00100000:1.0:1788837490.036399:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837490.036409:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708731392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837490.036627:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708731392:12345-0@lo:502:mount.lustre.0 Request processed in 220us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837490.036635:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837490.036878:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837490.036958:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788837490.036969:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788837490.038177:0:15168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788837490.038187:0:15168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788837490.038192:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.038195:0:15168:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788837490.038200:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788837490.038215:0:15168:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9acb7982b370) 00000020:00000080:3.0:1788837490.038235:0:15168:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788837490.038243:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788837490.038572:0:15168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb45de4800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788837490.038580:0:15168:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788837490.038587:0:15168:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x843cbef8be3064ff 00010000:00010000:3.0:1788837490.042190:0:15168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788837490.042931:0:15168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788837490.045063:0:15168:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788837490.052892:0:15168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788837490.052905:0:15168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837490.052911:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.052914:0:15168:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788837490.052919:0:15168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788837490.052921:0:15168:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788837490.052923:0:15168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788837490.052924:0:15168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788837490.052926:0:15168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788837490.052928:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.052930:0:15168:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788837490.052932:0:15168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837490.052935:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.052937:0:15168:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788837490.052940:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788837490.052942:0:15168:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788837490.052944:0:15168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837490.052946:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.052948:0:15168:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788837490.052950:0:15168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837490.052960:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.052962:0:15168:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788837490.052966:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788837490.053034:0:15168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837490.053037:0:15168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.053038:0:15168:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788837490.053042:0:15168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788837490.053805:0:15154:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788837490.053835:0:15154:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788837490.053901:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b600/0x843cbef8be3064ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064f1 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.053915:0:15154:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917b600/0x843cbef8be3064ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3064f1 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837490.053923:0:15154:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb45de4800 from 1 10000000:01000000:0.0:1788837490.053925:0:15154:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837490.053956:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.053963:0:15154:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.053974:0:15154:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837490.053995:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837490.054059:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.054094:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79169b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837490.054156:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708731520 00000100:00100000:3.0:1788837490.054163:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708731520 00000100:00100000:3.0:1788837490.054205:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837490.054213:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+14:15154:x1875731708731520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837490.054225:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837490.054237:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be306506 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837490.054258:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be306506 expref: 15 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837490.054268:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be306506 expref: 15 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837490.054277:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236e00, rc 0) 00000100:00100000:3.0:1788837490.054327:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708731520:12345-0@lo:101:mount.lustre.0 Request processed in 115us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837490.054334:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837490.055559:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837490.055582:0:15154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.055594:0:15154:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837490.056056:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788837490.056329:0:15154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837490.056946:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788837490.056991:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788837490.057054:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788837490.057062:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788837490.057135:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837490.057199:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.057244:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79169b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837490.057948:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708731648 00000100:00100000:3.0:1788837490.057956:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708731648 00000100:00100000:3.0:1788837490.058006:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788837490.058016:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708731648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837490.058280:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708731648:12345-0@lo:501:mount.lustre.0 Request processed in 264us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837490.058295:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837490.059928:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837490.059988:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837490.060054:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.060101:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79169b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837490.060144:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708731776 00000100:00100000:0.0:1788837490.060150:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708731776 00000100:00100000:0.0:1788837490.060200:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837490.060209:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708731776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837490.063256:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708731776:12345-0@lo:503:mount.lustre.0 Request processed in 3039us (3194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837490.063277:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837490.066629:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788837490.067865:0:15154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837490.067961:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837490.068038:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837490.068089:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb6341f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788837490.068373:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708731904 00000100:00100000:0.0:1788837490.068381:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708731904 00000100:00100000:0.0:1788837490.068425:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837490.068434:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708731904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837490.068614:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708731904:12345-0@lo:502:mount.lustre.0 Request processed in 180us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837490.068621:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837490.068685:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708731904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837490.068931:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788837490.068977:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788837490.069026:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788837490.069064:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788837490.069092:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788837490.069132:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788837490.069164:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788837490.069206:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788837490.069234:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837490.069277:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.069342:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79169cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837490.069622:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708732032 00000100:00100000:1.0:1788837490.069628:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708732032 00000100:00100000:1.0:1788837490.069668:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837490.069677:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708732032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837490.069846:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708732032:12345-0@lo:502:mount.lustre.0 Request processed in 170us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837490.069854:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837490.070118:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837490.070229:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788837490.070241:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788837490.072222:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837490.072235:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.072238:0:15172:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788837490.072246:0:15172:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb45de4800 00000020:00000080:3.0:1788837490.072249:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788837490.072260:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837490.072263:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.072264:0:15172:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788837490.072267:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837490.072269:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.072271:0:15172:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788837490.072274:0:15172:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb45de4800 00000020:00000080:3.0:1788837490.072277:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788837490.072668:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837490.072673:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.072674:0:15172:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788837490.072677:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837490.072680:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.072681:0:15172:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788837490.072685:0:15172:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9acb45de4800 00000020:00000080:3.0:1788837490.072687:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788837490.081945:0:15172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837490.081957:0:15172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837490.081959:0:15172:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788837490.081964:0:15172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788837490.082687:0:15154:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788837490.082794:0:15154:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837490.082851:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.082874:0:15154:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837490.082918:0:15154:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788837490.082921:0:15154:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9acb45de4800 10000000:01000000:0.0:1788837490.082924:0:15154:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9acb45de4800 10000000:01000000:0.0:1788837490.082928:0:15154:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837490.082934:0:15154:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb45de4800 from 1 10000000:01000000:0.0:1788837490.082937:0:15154:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837490.082973:0:15154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be306514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.082981:0:15154:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be306514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.082992:0:15154:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be306514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837490.083017:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837490.083081:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.083117:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb791696c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837490.083415:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708732160 00000100:00100000:3.0:1788837490.083423:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708732160 00000100:00100000:3.0:1788837490.083474:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837490.083483:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:15154:x1875731708732160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837490.083495:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837490.083513:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75236400/0x843cbef8be30651b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be306514 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837490.083537:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75236400/0x843cbef8be30651b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be306514 expref: 16 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837490.083547:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75236400/0x843cbef8be30651b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be306514 expref: 16 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837490.083555:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236400, rc 0) 00000100:00100000:3.0:1788837490.083601:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708732160:12345-0@lo:101:mount.lustre.0 Request processed in 119us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837490.083608:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837490.085656:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837490.085682:0:15154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be306514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30651b expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.085694:0:15154:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be306514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be30651b expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837490.086276:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788837490.086602:0:15154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837490.086830:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788837490.086874:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788837490.086908:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788837490.086954:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788837490.086991:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788837490.087046:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788837490.087076:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788837490.087102:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788837490.087137:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788837490.087178:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788837490.087204:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788837490.087242:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788837490.087269:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788837490.087294:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788837490.087370:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788837490.087402:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788837490.087427:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788837490.087474:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788837490.087505:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788837490.087531:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788837490.087568:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788837490.087595:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788837490.087621:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788837490.087655:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788837490.087682:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788837490.087721:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788837490.087765:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788837490.087799:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788837490.087874:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788837490.087887:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788837490.087964:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837490.088024:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.088062:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837490.088089:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708732288 00000100:00100000:0.0:1788837490.088094:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708732288 00000100:00100000:0.0:1788837490.088128:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837490.088136:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708732288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837490.088344:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708732288:12345-0@lo:501:mount.lustre.0 Request processed in 207us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837490.088351:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837490.088391:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837490.088414:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837490.088445:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.088455:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837490.093708:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708732416 00000100:00100000:3.0:1788837490.093722:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708732416 00000100:00100000:3.0:1788837490.093777:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788837490.093787:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708732416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837490.094008:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708732416:12345-0@lo:503:mount.lustre.0 Request processed in 222us (5560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837490.094015:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837490.099647:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732416:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788837490.103190:0:15154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837490.103284:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837490.104925:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.104971:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837490.105131:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708732544 00000100:00100000:2.0:1788837490.105138:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708732544 00000100:00100000:2.0:1788837490.105186:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788837490.105194:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708732544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837490.105605:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708732544:12345-0@lo:502:mount.lustre.0 Request processed in 409us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837490.105613:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837490.105838:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837490.106139:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788837490.106194:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788837490.106227:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788837490.106268:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788837490.106362:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788837490.106822:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788837490.106865:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788837490.106901:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788837490.106949:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788837490.107002:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788837490.107039:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788837490.107089:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788837490.107125:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788837490.107155:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788837490.107199:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788837490.107230:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788837490.107261:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788837490.107341:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788837490.107389:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788837490.107579:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788837490.107624:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788837490.107652:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788837490.107678:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788837490.107841:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788837490.107877:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788837490.107930:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788837490.107974:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788837490.108006:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788837490.108037:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788837490.108079:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788837490.108111:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788837490.108138:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788837490.108165:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788837490.108220:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788837490.108253:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788837490.108294:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788837490.108952:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788837490.109001:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788837490.109052:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788837490.109085:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788837490.109130:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837490.109203:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.109297:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837490.112861:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708732672 00000100:00100000:1.0:1788837490.112879:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708732672 00000100:00100000:1.0:1788837490.112974:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837490.112985:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708732672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837490.113262:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708732672:12345-0@lo:502:mount.lustre.0 Request processed in 279us (4059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837490.113270:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837490.114711:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708732672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837490.114852:0:15154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788837490.114868:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788837490.118834:0:15177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788837490.118851:0:15177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9acb79060000) 00000020:00000080:2.0:1788837490.118873:0:15177:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788837490.118961:0:15177:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb45de4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788837490.118965:0:15177:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9acb45de4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788837490.118967:0:15177:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb45de4800 3 00010000:00080000:2.0:1788837490.119008:0:15177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb46ac0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1788837490.121985:0:15177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788837490.122238:0:15177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788837490.122274:0:15177:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788837490.122289:0:15177:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x843cbef8be306529 00000100:00080000:2.0:1788837490.122337:0:15177:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837490.122345:0:15177:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9acb46ac0800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1788837490.122392:0:15177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb79047800 x1875731708732800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837490.122521:0:15177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788837490.122552:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837490.122556:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837490.122558:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837490.122561:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788837490.122614:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708732928:0@lo:400:kworker.0 00000100:00100000:2.0:1788837490.122693:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837490.122921:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708732928 00000100:00100000:2.0:1788837490.122929:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708732928 00000100:00100000:2.0:1788837490.122970:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837490.122980:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708732928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837490.123032:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708732928:12345-0@lo:400:kworker.0 Request processed in 53us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837490.123039:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788837490.123077:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9acb79044380 x1875731708732928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837490.123091:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708732928:0@lo:400:kworker.0 00000100:00100000:0.0:1788837490.123878:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1875731708732800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788837490.123931:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837490.124117:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708732800 00000100:00100000:3.0:1788837490.124123:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708732800 00000100:00100000:3.0:1788837490.124152:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837490.124159:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875731708732800:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788837490.124183:0:14474:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:3.0:1788837490.124220:0:14474:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x843cbef8be306530 00000004:00100000:3.0:1788837490.124236:0:14474:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788837490.124267:0:14474:0:(import.c:65:import_set_state_nolock()) ffff9acb741d4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837490.124957:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875731708732800:12345-0@lo:38:llog_process_th.0 Request processed in 793us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837490.124966:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788837490.125260:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9acb79047800 x1875731708732800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837490.125272:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837490.125280:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788837490.125287:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788837490.125292:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788837490.125295:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb46ac0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788837490.125515:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1875731708732800:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788837490.129170:0:15177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788837490.129909:0:15154:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788837490.129943:0:15154:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837490.129970:0:15154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be306514 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30651b expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.129984:0:15154:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917b800/0x843cbef8be306514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30651b expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788837490.130050:0:15154:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788837490.130052:0:15154:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837490.130054:0:15154:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837490.130055:0:15154:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837490.130056:0:15154:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837490.130058:0:15154:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837490.130059:0:15154:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837490.130061:0:15154:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837490.130062:0:15154:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837490.130066:0:15154:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788837490.130068:0:15154:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837490.130069:0:15154:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837490.130070:0:15154:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837490.130072:0:15154:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837490.130073:0:15154:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837490.130074:0:15154:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837490.130075:0:15154:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837490.130076:0:15154:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837490.130077:0:15154:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837490.130102:0:15154:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788837490.130122:0:15154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708733056:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788837490.130192:0:15154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.130271:0:15154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837490.136241:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708733056 00000100:00100000:2.0:1788837490.136254:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708733056 00000100:00100000:2.0:1788837490.136317:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788837490.136326:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708733056:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788837490.136364:0:14466:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788837490.136389:0:14466:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788837490.172096:0:14466:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788837490.172108:0:14466:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788837490.172134:0:14488:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788837490.172138:0:14488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788837490.172157:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172175:0:14488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30649d expref: 16 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172184:0:14488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172232:0:14488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30649d expref: 16 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172245:0:14488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30649d expref: 16 pid: 14467 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837490.172259:0:14488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14488:1875731708733184:0@lo:104: 00000100:00100000:0.0:1788837490.172354:0:14488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837490.172681:0:14488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837490.172721:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708733184 00000100:00100000:0.0:1788837490.172729:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708733184 00000100:00100000:0.0:1788837490.172770:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837490.172778:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:14488:x1875731708733184:12345-0@lo:104: 00010000:00010000:0.0:1788837490.172790:0:14456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172835:0:14456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837490.172841:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:14488:x1875731708733184:12345-0@lo:104: Request processed in 64us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837490.172848:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788837490.172868:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837490.172874:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172882:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576c00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837490.172885:0:14460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172904:0:14460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837490.172911:0:14460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837490.172917:0:14460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837490.172945:0:14460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172952:0:14460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837490.172973:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172980:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7f576c00/0x843cbef8be30649d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3064a4 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.172995:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837490.172997:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837490.172998:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837490.173021:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3313:1875731708733312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837490.173052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837490.178228:0:14488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14488:1875731708733184:0@lo:104: 00010000:00010000:2.0:1788837490.178256:0:14488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837490.178976:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15154:x1875731708733056:12345-0@lo:253:mount.lustre.0 Request processed in 42648us (48780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837490.178988:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837490.179079:0:15154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15154:1875731708733056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788837490.179091:0:15154:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788837490.179094:0:15154:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788837490.179096:0:15154:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788837490.179097:0:15154:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837490.179098:0:15154:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837490.179099:0:15154:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837490.179100:0:15154:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837490.179102:0:15154:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837490.179103:0:15154:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837490.179118:0:15154:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788837490.179130:0:15154:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788837490.181628:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708733312 00000100:00100000:0.0:1788837490.181644:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708733312 00010000:00010000:0.0:1788837490.181686:0:14459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30649d expref: 16 pid: 14467 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837490.181742:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837490.181753:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:3313:x1875731708733312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837490.181787:0:14459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837490.181793:0:14459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30649d expref: 16 pid: 14467 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181807:0:14459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30649d expref: 16 pid: 14467 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181826:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f543800/0x843cbef8be3064a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30649d expref: 16 pid: 14467 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181845:0:14459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181854:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788837490.181869:0:14459:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009732247s 00010000:00010000:0.0:1788837490.181874:0:14459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181881:0:14459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181888:0:14459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181895:0:14459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181901:0:14459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b200 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837490.181905:0:14459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181918:0:14459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181935:0:14459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181945:0:14459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837490.181964:0:14488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181972:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837490.181978:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7917b200/0x843cbef8be306537 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837490.182051:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:3313:x1875731708733312:12345-0@lo:103:ldlm_bl.0 Request processed in 300us (8997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837490.182058:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837490.182100:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3313:1875731708733312:0@lo:103:ldlm_bl.0 00080000:10000000:1.0:1788837490.186162:0:15154:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788837490.186838:0:15154:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788837490.186997:0:15154:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788837490.187144:0:15154:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788837490.187290:0:15154:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788837490.187938:0:15154:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788837490.189188:0:15154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788837490.264791:0:15154:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788837490.264799:0:15154:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788837490.264832:0:15154:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788837490.264891:0:15154:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788837490.264909:0:15154:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788837490.264935:0:15154:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788837490.981873:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788837491.237609:0:14470:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788837491.237616:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9acb47ed0000 from 7 10000000:01000000:0.0:1788837491.237620:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837491.237668:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837491.237686:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837491.237698:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837491.237720:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708733440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837491.237781:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837491.237828:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb74c6d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837491.237970:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708733440 00000100:00100000:1.0:1788837491.237977:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708733440 00000100:00100000:1.0:1788837491.238031:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837491.238040:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+15:14470:x1875731708733440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837491.238052:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837491.238065:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30653e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837491.238086:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30653e expref: 16 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837491.238096:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30653e expref: 16 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837491.238104:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576600, rc 0) 00000100:00100000:1.0:1788837491.238146:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:14470:x1875731708733440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837491.238152:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788837491.238234:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708733440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837491.238248:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837491.238257:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837491.238343:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708733568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788837491.238494:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837491.238513:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb42b98900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837491.238630:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708733568 00000100:00100000:1.0:1788837491.238635:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708733568 00000100:00100000:1.0:1788837491.238781:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788837491.238789:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:14470:x1875731708733568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788837491.238803:0:14466:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788837491.238819:0:14466:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788837491.238822:0:14466:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788837491.238899:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:14470:x1875731708733568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837491.238905:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788837491.245293:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708733568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788837491.245405:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788837491.245417:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837491.245427:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837492.006608:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837493.032997:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837494.053497:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837495.077659:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788837495.142458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837495.142465:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837495.142468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837495.142471:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788837495.142517:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708733696:0@lo:400:kworker.0 00000100:00100000:2.0:1788837495.142587:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837495.142651:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708733824:0@lo:400:kworker.0 00000100:00100000:2.0:1788837495.142681:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837495.142711:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837495.142717:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708733952:0@lo:400:kworker.0 00000100:00100000:2.0:1788837495.142742:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837495.142777:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708733824 00000100:00100000:2.0:1788837495.142786:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708733824 00000100:00100000:2.0:1788837495.142823:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708733952 00000100:00100000:2.0:1788837495.142826:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708733952 00000100:00100000:2.0:1788837495.142851:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837495.142858:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708733824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837495.142903:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708733824:12345-0@lo:400:kworker.0 Request processed in 45us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837495.142910:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837495.142924:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837495.142930:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708733952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837495.142952:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708733952:12345-0@lo:400:kworker.0 Request processed in 23us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837495.142957:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788837495.142987:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb79047800 x1875731708733952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837495.143001:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708733952:0@lo:400:kworker.0 00010000:00080000:2.0:1788837495.143011:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb79044700 x1875731708733824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837495.143019:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708733824:0@lo:400:kworker.0 00000100:00080000:1.0:1788837495.143416:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837495.143534:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708733696 00000100:00100000:2.0:1788837495.143540:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708733696 00000100:00100000:2.0:1788837495.143580:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788837495.143596:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:3314:x1875731708733696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837495.143642:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:3314:x1875731708733696:12345-0@lo:400:kworker.0 Request processed in 48us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837495.143649:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788837495.143690:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708733696:0@lo:400:kworker.0 00010000:00010000:0.0:1788837496.101445:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837497.041993:0:15522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788837497.125709:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837498.149616:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837499.180748:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837499.560994:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788837500.198899:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837500.264621:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788837500.264628:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788837500.264643:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788837500.264647:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788837500.264701:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708734208:0@lo:400:kworker.0 00000100:00100000:0.0:1788837500.264772:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837500.264918:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837500.264926:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708734080:0@lo:400:kworker.0 00000100:00100000:0.0:1788837500.264958:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837500.264990:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708734336:0@lo:400:kworker.0 00000100:00100000:0.0:1788837500.265019:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837500.273443:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708734080 00000100:00100000:3.0:1788837500.273455:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708734080 00000100:00100000:3.0:1788837500.273521:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788837500.273545:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:3314:x1875731708734080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837500.273909:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:3314:x1875731708734080:12345-0@lo:400:kworker.0 Request processed in 378us (8948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837500.273918:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788837500.278390:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708734208 00000100:00100000:2.0:1788837500.278417:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708734208 00000100:00100000:2.0:1788837500.278502:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708734336 00000100:00100000:2.0:1788837500.278506:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708734336 00000100:00100000:2.0:1788837500.278545:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837500.278555:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708734208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837500.278644:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708734208:12345-0@lo:400:kworker.0 Request processed in 91us (13871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837500.278651:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837500.278666:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837500.278673:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708734336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837500.278706:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708734336:12345-0@lo:400:kworker.0 Request processed in 34us (13687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837500.278712:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788837500.278752:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb74c79180 x1875731708734336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837500.278770:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837500.278843:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708734336:0@lo:400:kworker.0 00000100:00100000:2.0:1788837500.279047:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708734080:0@lo:400:kworker.0 00010000:00080000:2.0:1788837500.279076:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb74c7b480 x1875731708734208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837500.279087:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708734208:0@lo:400:kworker.0 00010000:00010000:3.0:1788837501.221556:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837501.413490:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837486/real 1788837486] req@ffff9acb79633100 x1875731708730112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837501 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837501.413521:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9acb79633100 x1875731708730112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837501 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837501.413532:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837486/real 1788837486] req@ffff9acb79632a00 x1875731708730240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837501 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837501.413543:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9acb79632a00 x1875731708730240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837501 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788837501.413562:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb79159000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837501.413586:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788837501.413590:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708730112:0@lo:8:kworker.0 00000100:00080000:0.0:1788837501.413597:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb45cdb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837501.413602:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788837501.413605:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708730240:0@lo:8:kworker.0 00000100:00080000:3.0:1788837501.413737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837501.413742:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788837501.413744:0:8:0:(import.c:65:import_set_state_nolock()) ffff9acb79159000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837501.413763:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:3.0:1788837501.413768:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788837501.413774:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9acb79159000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1788837501.413793:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb79631f80 x1875731708734592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837501.413806:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837501.413809:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788837501.413811:0:8:0:(import.c:65:import_set_state_nolock()) ffff9acb45cdb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837501.413814:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:3.0:1788837501.413816:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788837501.413819:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9acb45cdb000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1788837501.413830:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb79630380 x1875731708734720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837501.413878:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708734848:0@lo:400:kworker.0 00000100:00100000:3.0:1788837501.413935:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837501.413992:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837501.413997:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708734976:0@lo:400:kworker.0 00000100:00100000:3.0:1788837501.414023:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837501.414058:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708734848 00000100:00100000:3.0:1788837501.414065:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708734848 00000100:00100000:3.0:1788837501.414114:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708734976 00000100:00100000:3.0:1788837501.414117:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708734976 00000100:00100000:3.0:1788837501.414137:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837501.414144:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708734848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837501.414268:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3316:1875731708734464:0@lo:400:kworker.0 00000100:00100000:1.0:1788837501.414328:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837501.414363:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708734464 00000100:00100000:1.0:1788837501.414367:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708734464 00000100:00100000:1.0:1788837501.414414:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837501.414421:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:3316:x1875731708734464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837501.414457:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:3316:x1875731708734464:12345-0@lo:400:kworker.0 Request processed in 36us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837501.414463:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837501.414503:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3316:1875731708734464:0@lo:400:kworker.0 00000100:00100000:0.0:1788837501.414698:0:14474:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788837501.414707:0:14474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788837501.414915:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837501.414926:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708734976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837501.414971:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708734976:12345-0@lo:400:kworker.0 Request processed in 48us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837501.414977:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837501.415001:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708734592:0@lo:8:kworker.0 00000100:00100000:0.0:1788837501.415034:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837501.415052:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708734720:0@lo:8:kworker.0 00000100:00100000:0.0:1788837501.415084:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837501.415138:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708734592 00000100:00100000:0.0:1788837501.415143:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708734592 00000100:00100000:0.0:1788837501.415161:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708734720 00000100:00100000:0.0:1788837501.415164:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708734720 00000100:00100000:3.0:1788837501.416710:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875731708734848:12345-0@lo:400:kworker.0 Request processed in 2558us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837501.416737:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837501.417214:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837501.417224:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1875731708734592:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788837501.417259:0:15155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1788837501.417294:0:15155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be30654c 00002000:00100000:0.0:1788837501.417325:0:15155:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9acb437e0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788837501.417330:0:15155:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788837501.417332:0:15155:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788837501.417817:0:15155:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788837501.417845:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9acb437e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837501.417932:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875731708734592:12345-0@lo:8:kworker.0 Request processed in 707us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837501.417941:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837501.417963:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837501.417969:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1875731708734720:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788837501.417980:0:15155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788837501.418006:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1875731708734720:12345-0@lo:8:kworker.0 Request processed in 37us (2922us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837501.418013:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788837501.418065:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb79633480 x1875731708734976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837501.418080:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708734976:0@lo:400:kworker.0 00010000:00080000:0.0:1788837501.418121:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb79630700 x1875731708734848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837501.418130:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875731708734848:0@lo:400:kworker.0 00010000:00080000:3.0:1788837501.424905:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb79631f80 x1875731708734592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837501.424922:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837501.424934:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788837501.424946:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788837501.424954:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788837501.424958:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb79159000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788837501.424975:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788837501.424981:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708734592:0@lo:8:kworker.0 00000100:00080000:3.0:1788837501.424997:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb45cdb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837501.425001:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837501.425004:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708734720:0@lo:8:kworker.0 00000004:00080000:3.0:1788837501.425082:0:14495:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788837501.425120:0:14495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14495:1875731708735232:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788837501.425199:0:14495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837501.425225:0:14495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788837501.425238:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837501.425246:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708735104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837501.425271:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837501.426599:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708735232 00000100:00100000:0.0:1788837501.426614:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708735232 00000100:00100000:0.0:1788837501.426692:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837501.426703:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14495:x1875731708735232:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788837501.431352:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708735104 00000100:00100000:1.0:1788837501.431582:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708735104 00000100:00100000:1.0:1788837501.431635:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837501.431644:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875731708735104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837501.431677:0:15159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837501.431751:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875731708735104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (6478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837501.431768:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788837501.431949:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb79630380 x1875731708735104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837501.431973:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708735104:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788837501.432070:0:14494:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788837501.433297:0:14494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 455283991244ns, next at 0ns, rc = 0 00000100:00080000:1.0:1788837501.440970:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788837501.444860:0:15155:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788837501.444873:0:15155:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788837501.444879:0:15155:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1788837501.473595:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.473610:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473627:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.473631:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.473638:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473656:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473667:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473675:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473706:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.473721:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.473727:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473735:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917aa00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.473740:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473749:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473765:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473773:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be306553 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.473790:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.473793:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.473795:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.474699:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.474708:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.474722:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.474732:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.474738:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.474750:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.474760:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.474768:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.474788:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.474799:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.474804:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.474812:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917bc00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.474815:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.474822:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.474836:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.474854:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda0d7ed/0x843cbef8be30655a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.475428:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.475431:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.475433:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.476564:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.476578:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476596:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.476601:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.476608:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476623:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476633:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476641:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476661:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.476673:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.476687:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476696:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a600 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.476702:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476712:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476729:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476736:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac38582/0x843cbef8be306561 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.476754:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.476757:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.476760:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.479205:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.479218:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479234:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.479239:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.479246:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479272:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479283:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479289:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479331:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837501.479762:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.479767:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479775:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.479777:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.479781:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479789:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479796:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479816:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479833:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788837501.479847:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837501.479853:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479877:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ba00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.479882:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479891:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479907:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479914:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7949ad5/0x843cbef8be306568 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479930:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.479933:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479950:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917be00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.479954:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479962:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479971:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479977:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000656fd8a2/0x843cbef8be30656f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.479989:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.479991:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.479992:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.480424:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.480430:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480440:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.480443:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.480447:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480456:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480471:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480478:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480491:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.480500:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.480503:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480510:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ac00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.480513:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480520:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480532:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480538:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003daafd43/0x843cbef8be306576 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480551:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.480558:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.480560:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.480909:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.480916:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480925:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.480928:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.480933:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480941:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480949:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480955:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480968:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.480975:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.480979:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.480985:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.480988:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481007:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481017:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481024:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fa62f42/0x843cbef8be30657d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481036:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.481038:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.481039:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.481442:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.481449:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481458:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.481461:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.481466:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481475:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481482:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481495:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481508:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.481517:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.481520:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481527:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917ae00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.481529:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481535:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481545:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481551:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000642e4c4c/0x843cbef8be306584 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481563:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.481565:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.481566:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.481946:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.481960:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481968:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.481971:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.481975:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481983:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481990:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.481997:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.482010:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.482018:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.482021:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.482028:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.482031:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.482039:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.482057:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.482064:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca91ff7/0x843cbef8be30658b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.482077:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.482079:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.482080:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837501.482760:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.491970:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.491987:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492007:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.492012:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.492019:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492034:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492046:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492054:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492092:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.492107:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.492114:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492123:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.492128:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492137:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492152:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492159:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000392f2823/0x843cbef8be306592 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492178:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.492179:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.492181:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.492717:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.492724:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492734:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.492743:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.492748:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492758:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492766:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492772:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492788:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.492798:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.492803:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492810:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167be00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.492813:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492820:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492830:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492848:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be248ee9/0x843cbef8be306599 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.492863:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.492865:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.492866:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.495158:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.495171:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495189:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.495194:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.495200:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495214:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495224:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495232:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495254:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.495268:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.495280:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495289:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.495293:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495315:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495331:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495339:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2e79660/0x843cbef8be3065a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495356:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.495358:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.495360:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.495843:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.495849:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.495859:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.497322:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.497332:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.497368:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.497392:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.497401:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.497442:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.497454:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.497460:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.497467:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167b600 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.497472:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.497481:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.497496:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.497504:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1d958c/0x843cbef8be3065a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.497535:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.497539:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.497540:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.499542:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.499556:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499572:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.499576:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.499582:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499595:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499606:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499613:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499630:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.499641:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.499646:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499666:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167b400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.499671:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499680:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499697:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499705:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b026ad11/0x843cbef8be3065ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.499726:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.499728:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.499730:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.500246:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.500253:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500263:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.500266:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.500272:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500282:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500297:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500324:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500339:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.500349:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.500354:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500362:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ac00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.500366:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500374:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500399:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500406:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e6ddd42/0x843cbef8be3065b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500422:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.500429:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.500431:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.500824:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.500832:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500840:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.500844:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.500849:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500859:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500867:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500875:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500890:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.500898:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.500902:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500909:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167ae00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.500912:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500930:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500940:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500947:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb27ea99/0x843cbef8be3065bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.500959:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.500960:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.500962:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.501401:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.501408:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.501417:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.501421:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.501425:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.501434:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.501442:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.501456:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.501477:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837501.502449:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837501.502460:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.502471:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167a800 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837501.502477:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.502487:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.502510:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.502517:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bbfc2dc/0x843cbef8be3065c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.502538:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837501.502540:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837501.502541:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.505238:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.505253:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505271:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.505276:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.505283:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505297:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505327:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505335:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505352:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.505364:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.505370:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505640:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb4167b800 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.505646:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505656:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505673:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505682:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001180266a/0x843cbef8be3065ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.505703:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.505705:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.505707:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.506570:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.506578:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506591:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.506595:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.506600:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506611:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506627:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506634:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506652:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.506662:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.506668:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506674:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917aa00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.506678:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506685:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506697:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506704:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fac654e/0x843cbef8be3065d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.506720:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.506726:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.506727:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.507830:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.507839:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.507854:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.507858:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.509886:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.509907:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.509919:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.509927:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.509953:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.509974:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.509979:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.509987:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.509992:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.510016:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.510033:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.510041:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ee2141/0x843cbef8be3065d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.510064:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.510066:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.510068:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.510723:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.510731:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.510743:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.510747:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.510753:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.510763:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.510772:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.510791:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.510822:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837501.511041:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837501.511049:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.511059:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075ce00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837501.511069:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.511078:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.511101:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.511109:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e266be2b/0x843cbef8be3065df lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837501.516649:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.516664:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.516683:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.516687:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.516694:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.516708:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.516718:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.516725:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.516752:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.516774:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837501.517122:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837501.517126:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837501.517129:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.517596:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.517612:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517623:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.517627:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.517632:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517645:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517654:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517662:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517679:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.517688:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.517692:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517700:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c800 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.517705:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517713:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517737:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517745:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a09442d/0x843cbef8be3065ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.517762:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.517764:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.517766:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837501.518144:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837501.518147:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837501.518149:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.520981:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521001:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075de00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.521006:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521016:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521036:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521044:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bdfda36/0x843cbef8be3065e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521086:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.521088:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.521091:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.521712:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.521720:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521734:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.521739:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.521746:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521759:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521769:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521778:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521794:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837501.521803:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.521808:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521828:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.521832:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521842:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521857:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521878:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d04fa27f/0x843cbef8be3065f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.521899:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.521902:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.521905:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837501.522336:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.522343:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522353:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.522356:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.522361:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522372:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522402:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522409:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522425:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837501.522859:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.522866:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522876:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.522880:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.522885:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522896:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522905:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522913:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522941:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788837501.522952:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837501.522957:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522966:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.522970:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522978:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522991:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.522997:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a707b5/0x843cbef8be3065fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.523012:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837501.523015:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.523021:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d800 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837501.523024:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.523044:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.523055:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.523062:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a995082/0x843cbef8be306602 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.523075:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.523076:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837501.523078:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837501.524471:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788837501.527475:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788837501.528034:0:15155:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837501.528045:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.528063:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1788837501.528067:0:15155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837501.528074:0:15155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.528089:0:15155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.528100:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.528121:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837501.528148:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837501.528187:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837501.528196:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.528206:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075cc00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:1.0:1788837501.528211:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.528221:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.528252:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.528259:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a53589e0/0x843cbef8be306609 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837501.528280:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837501.528283:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837501.528286:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788837501.528437:0:15155:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788837501.528540:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14495:x1875731708735232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 101835us (103336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837501.528549:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837501.528589:0:14495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14495:1875731708735232:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788837501.528606:0:14495:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788837501.528648:0:14495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79044380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14495:1875731708735360:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788837501.528685:0:14495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837501.528733:0:14495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d247240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837501.528787:0:15157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708735360 00000100:00100000:1.0:1788837501.528794:0:15157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708735360 00000100:00100000:1.0:1788837501.528839:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837501.528848:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14495:x1875731708735360:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788837501.528884:0:15157:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788837501.548668:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14495:x1875731708735360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19813us (19975us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788837501.548686:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837501.548914:0:14495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79044380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14495:1875731708735360:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788837501.548933:0:14495:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788837502.248520:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837503.272277:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837504.295900:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788837504.917833:0:15874:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788837504.917837:0:15874:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788837504.918492:0:15874:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9acb741d6800 00000020:01000004:3.0:1788837504.918509:0:15874:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788837504.918523:0:15874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788837504.918538:0:15874:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9acb79828000) 00000020:00000080:3.0:1788837504.918554:0:15874:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788837504.962413:0:15874:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788837504.962880:0:15874:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788837504.963969:0:15874:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788837504.964430:0:15874:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788837504.964864:0:15874:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788837504.965525:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 427: rc = 0 00100000:10000000:0.0:1788837504.967788:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 427: rc = 0 00100000:10000000:0.0:1788837504.967970:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 427: rc = 0 00100000:10000000:0.0:1788837504.969183:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 240: rc = 0 00100000:10000000:0.0:1788837504.971228:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 240: rc = 0 00100000:10000000:0.0:1788837504.971817:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 240: rc = 0 00100000:10000000:0.0:1788837504.974430:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 240: rc = 0 00100000:10000000:0.0:1788837504.974719:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 240: rc = 0 00100000:10000000:0.0:1788837504.974947:0:15874:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 240: rc = 0 00000020:00000080:0.0:1788837504.979496:0:15874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788837504.979517:0:15874:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788837504.979527:0:15874:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x843cbef8be306617 00000020:01000004:0.0:1788837504.979535:0:15874:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788837504.979555:0:15874:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788837504.979559:0:15874:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788837504.979565:0:15874:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788837504.979585:0:15874:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788837504.979588:0:15874:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788837504.991015:0:15874:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788837504.991055:0:15874:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788837504.991060:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788837504.991062:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837504.991064:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837504.991066:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837504.991067:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837504.991069:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837504.991070:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837504.991072:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837504.991073:0:15874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837504.991077:0:15874:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788837504.991079:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837504.991081:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837504.991082:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837504.991083:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837504.991084:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837504.991085:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837504.991086:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837504.991087:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837504.991088:0:15874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837504.991116:0:15874:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788837504.991136:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708735488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788837504.991213:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837504.991271:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837504.991544:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708735488 00000100:00100000:3.0:1788837504.991552:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708735488 00000100:00100000:3.0:1788837504.991662:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788837504.991674:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15874:x1875731708735488:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788837504.991717:0:14464:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788837504.991720:0:14464:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788837504.991724:0:14464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788837505.005189:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15874:x1875731708735488:12345-0@lo:253:mount.lustre.0 Request processed in 13508us (13967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837505.005203:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788837505.005423:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708735488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788837505.005438:0:15874:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788837505.005453:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837505.005455:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837505.005456:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837505.005458:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837505.005459:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837505.005460:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837505.005462:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837505.005463:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837505.005465:0:15874:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788837505.005545:0:15874:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9acb741d6800 from lustre-OST0001 10000000:01000000:2.0:1788837505.005571:0:15874:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788837505.005574:0:15874:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788837505.005582:0:15874:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9acb58733370 local copy 00010000:00010000:2.0:1788837505.005592:0:15874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837505.005827:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708735616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837505.005876:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.005953:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d33d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837505.006223:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708735616 00000100:00100000:3.0:1788837505.006230:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708735616 00000100:00100000:3.0:1788837505.006433:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788837505.006445:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15874:x1875731708735616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837505.006747:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15874:x1875731708735616:12345-0@lo:501:mount.lustre.0 Request processed in 305us (871us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837505.006755:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788837505.006835:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708735616:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788837505.006851:0:15874:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788837505.006996:0:15874:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788837505.007004:0:15874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.007014:0:15874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7917a800/0x843cbef8be3063c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3063cb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837505.007037:0:15874:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9acb741d6800 10000000:01000000:2.0:1788837505.007042:0:15874:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788837505.007060:0:15874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788837505.007064:0:15874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837505.007068:0:15874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788837505.007070:0:15874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788837505.007095:0:15874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f542e00/0x843cbef8be30661e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.007103:0:15874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f542e00/0x843cbef8be30661e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.007111:0:15874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f542e00/0x843cbef8be30661e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837505.007127:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708735744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837505.007158:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.007648:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d33d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837505.007972:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708735744 00000100:00100000:1.0:1788837505.007979:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708735744 00000100:00100000:1.0:1788837505.008014:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837505.008022:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:15874:x1875731708735744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837505.008032:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837505.008110:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f577a00/0x843cbef8be306625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30661e expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.008136:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577a00/0x843cbef8be306625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30661e expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.008146:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f577a00/0x843cbef8be306625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30661e expref: 17 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.008162:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577a00, rc 0) 00000100:00100000:1.0:1788837505.008216:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708735744:12345-0@lo:101:mount.lustre.0 Request processed in 195us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837505.008223:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788837505.008427:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708735744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837505.008442:0:15874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f542e00/0x843cbef8be30661e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306625 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.008451:0:15874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f542e00/0x843cbef8be30661e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be306625 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837505.009419:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788837505.010622:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837505.010815:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788837505.010843:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788837505.010952:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788837505.010994:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788837505.011013:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788837505.011029:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788837505.011078:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788837505.011086:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788837505.011165:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708735872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837505.011229:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.011279:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb6341f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788837505.011456:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708735872 00000100:00100000:1.0:1788837505.011464:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708735872 00000100:00100000:1.0:1788837505.011549:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837505.011558:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708735872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837505.011942:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708735872:12345-0@lo:501:mount.lustre.0 Request processed in 384us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837505.011950:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788837505.012021:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708735872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837505.012065:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837505.012104:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.012581:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb6341f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788837505.012752:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708736000 00000100:00100000:3.0:1788837505.012759:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708736000 00000100:00100000:3.0:1788837505.012790:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788837505.012799:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708736000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837505.013125:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708736000:12345-0@lo:503:mount.lustre.0 Request processed in 326us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.013140:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788837505.013436:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736000:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788837505.014025:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837505.014113:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837505.014167:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.014198:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d235840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837505.014524:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708736128 00000100:00100000:3.0:1788837505.014530:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708736128 00000100:00100000:3.0:1788837505.014562:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788837505.014570:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708736128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837505.014801:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708736128:12345-0@lo:502:mount.lustre.0 Request processed in 230us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.014808:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837505.014927:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837505.015154:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788837505.015200:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788837505.015232:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788837505.015289:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788837505.015372:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788837505.015409:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788837505.015459:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788837505.015499:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788837505.015549:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788837505.015581:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837505.015853:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.015890:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d235840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837505.015946:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708736256 00000100:00100000:3.0:1788837505.015952:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708736256 00000100:00100000:3.0:1788837505.015982:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788837505.015990:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708736256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837505.016174:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708736256:12345-0@lo:502:mount.lustre.0 Request processed in 185us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.016182:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788837505.016472:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837505.016549:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788837505.016560:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788837505.017670:0:15876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788837505.017679:0:15876:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788837505.017686:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837505.017688:0:15876:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788837505.017693:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837505.017706:0:15876:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9acb79064d28) 00000020:00000080:2.0:1788837505.017744:0:15876:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788837505.017751:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788837505.017816:0:15876:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb741d6800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788837505.017824:0:15876:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788837505.017831:0:15876:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x843cbef8be306633 00010000:00010000:2.0:1788837505.024711:0:15876:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788837505.028834:0:15876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788837505.031012:0:15876:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788837505.037502:0:15876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788837505.037514:0:15876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837505.037521:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837505.037523:0:15876:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788837505.037529:0:15876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837505.037532:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837505.037534:0:15876:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788837505.037537:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788837505.037538:0:15876:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788837505.037541:0:15876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837505.037543:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837505.037544:0:15876:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788837505.037546:0:15876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837505.037554:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837505.037555:0:15876:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788837505.037559:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788837505.042321:0:15876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837505.042336:0:15876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837505.042339:0:15876:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788837505.042346:0:15876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788837505.042530:0:15874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788837505.042556:0:15874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788837505.042579:0:15874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f542e00/0x843cbef8be30661e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306625 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.042591:0:15874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f542e00/0x843cbef8be30661e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306625 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837505.042599:0:15874:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb741d6800 from 1 10000000:01000000:2.0:1788837505.042611:0:15874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837505.042646:0:15874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.042655:0:15874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.042665:0:15874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837505.042688:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837505.042752:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.042794:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837505.042994:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708736384 00000100:00100000:1.0:1788837505.043002:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708736384 00000100:00100000:1.0:1788837505.043052:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788837505.043062:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:15874:x1875731708736384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837505.043074:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837505.043086:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be30663a expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.043109:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be30663a expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.043120:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30663a expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.043129:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576000, rc 0) 00000100:00100000:1.0:1788837505.043183:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708736384:12345-0@lo:101:mount.lustre.0 Request processed in 123us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837505.043191:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788837505.043353:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837505.043380:0:15874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.043390:0:15874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837505.043898:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788837505.044180:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837505.044497:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788837505.044540:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788837505.044600:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788837505.044608:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788837505.044666:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837505.044713:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.044752:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837505.046034:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708736512 00000100:00100000:0.0:1788837505.046045:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708736512 00000100:00100000:0.0:1788837505.046096:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788837505.046105:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708736512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837505.046413:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708736512:12345-0@lo:501:mount.lustre.0 Request processed in 308us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837505.046421:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788837505.050589:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837505.050657:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837505.050736:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.050784:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837505.050850:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708736640 00000100:00100000:3.0:1788837505.050858:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708736640 00000100:00100000:3.0:1788837505.050911:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788837505.050921:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708736640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837505.051214:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708736640:12345-0@lo:503:mount.lustre.0 Request processed in 293us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.051222:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788837505.051352:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79047800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736640:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788837505.052229:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837505.052336:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837505.052403:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837505.052428:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837505.052516:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708736768 00000100:00100000:3.0:1788837505.052521:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708736768 00000100:00100000:3.0:1788837505.052558:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788837505.052566:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708736768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837505.052748:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708736768:12345-0@lo:502:mount.lustre.0 Request processed in 182us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.052756:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788837505.053006:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837505.053245:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788837505.053294:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788837505.053847:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788837505.053882:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788837505.053910:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788837505.053954:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788837505.053989:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788837505.054021:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788837505.054068:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837505.054128:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837505.054246:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837505.054771:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708736896 00000100:00100000:3.0:1788837505.054780:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708736896 00000100:00100000:3.0:1788837505.054817:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788837505.054824:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7accd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708736896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837505.055075:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7accd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708736896:12345-0@lo:502:mount.lustre.0 Request processed in 250us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.055083:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788837505.061612:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708736896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837505.061811:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788837505.061828:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788837505.062681:0:15880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837505.062691:0:15880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837505.062694:0:15880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788837505.062699:0:15880:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb741d6800 00000020:00000080:1.0:1788837505.062702:0:15880:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788837505.062709:0:15880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837505.062711:0:15880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837505.062712:0:15880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788837505.062714:0:15880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837505.062717:0:15880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837505.062718:0:15880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788837505.062721:0:15880:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9acb741d6800 00000020:00000080:1.0:1788837505.062723:0:15880:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788837505.062783:0:15880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837505.062787:0:15880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837505.062789:0:15880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788837505.062791:0:15880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837505.062793:0:15880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837505.062795:0:15880:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788837505.062798:0:15880:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9acb741d6800 00000020:00000080:1.0:1788837505.062800:0:15880:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788837505.062831:0:15880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837505.062835:0:15880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837505.062836:0:15880:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788837505.062839:0:15880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788837505.071878:0:15874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788837505.071921:0:15874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837505.071946:0:15874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.071960:0:15874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837505.072011:0:15874:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788837505.072014:0:15874:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9acb741d6800 10000000:01000000:2.0:1788837505.072023:0:15874:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9acb741d6800 10000000:01000000:2.0:1788837505.072028:0:15874:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837505.072034:0:15874:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9acb741d6800 from 1 10000000:01000000:2.0:1788837505.072037:0:15874:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837505.072070:0:15874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f542c00/0x843cbef8be306648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.072078:0:15874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f542c00/0x843cbef8be306648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.072089:0:15874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f542c00/0x843cbef8be306648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837505.072112:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837505.072177:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.072219:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708737024 00000100:00100000:2.0:1788837505.072226:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708737024 00000100:00100000:2.0:1788837505.072265:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788837505.072274:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7acce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708737024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837505.072287:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837505.072299:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f542400/0x843cbef8be30664f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be306648 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.072366:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f542400/0x843cbef8be30664f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be306648 expref: 19 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.072377:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f542400/0x843cbef8be30664f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be306648 expref: 19 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.072385:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542400, rc 0) 00000100:00100000:2.0:1788837505.072419:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7acce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708737024:12345-0@lo:101:mount.lustre.0 Request processed in 147us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837505.072425:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788837505.072465:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837505.072482:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837505.072494:0:15874:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f542c00/0x843cbef8be306648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30664f expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837505.072501:0:15874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f542c00/0x843cbef8be306648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be30664f expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837505.073080:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788837505.073407:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837505.073835:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788837505.073877:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788837505.073907:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788837505.073951:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788837505.074000:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788837505.074042:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788837505.074073:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788837505.074106:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788837505.074154:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788837505.074186:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788837505.074215:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788837505.074261:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788837505.074298:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788837505.079573:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788837505.079662:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788837505.079702:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788837505.079736:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788837505.079783:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788837505.079832:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788837505.079863:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788837505.079946:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788837505.079984:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788837505.080019:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788837505.080069:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788837505.080106:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788837505.080140:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788837505.080186:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788837505.080223:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788837505.080258:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788837505.080332:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788837505.091717:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788837505.091812:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788837505.091850:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788837505.091924:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788837505.091963:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788837505.092013:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788837505.092076:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788837505.092169:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788837505.092177:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788837505.092274:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837505.092406:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.092451:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708737152 00000100:00100000:2.0:1788837505.092458:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708737152 00000100:00100000:2.0:1788837505.092501:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837505.092510:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7accd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708737152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837505.092747:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7accd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708737152:12345-0@lo:501:mount.lustre.0 Request processed in 236us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837505.092755:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837505.092805:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837505.092828:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837505.092863:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837505.092904:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.092926:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708737280 00000100:00100000:2.0:1788837505.092930:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708737280 00000100:00100000:2.0:1788837505.092952:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788837505.092958:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708737280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837505.093220:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708737280:12345-0@lo:503:mount.lustre.0 Request processed in 260us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837505.093227:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788837505.093262:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837505.093275:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788837505.093777:0:15874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837505.093841:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837505.093885:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.093917:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708737408 00000100:00100000:2.0:1788837505.093922:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708737408 00000100:00100000:2.0:1788837505.093950:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788837505.093958:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708737408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837505.094168:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708737408:12345-0@lo:502:mount.lustre.0 Request processed in 209us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837505.094175:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788837505.094213:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837505.094227:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837505.102714:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788837505.102801:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788837505.102832:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788837505.102875:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788837505.102913:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788837505.102962:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788837505.103000:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788837505.103036:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788837505.103102:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788837505.103140:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788837505.103175:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788837505.103242:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788837505.103279:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788837505.104532:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788837505.104624:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788837505.104661:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788837505.104694:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788837505.104738:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788837505.104767:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788837505.104795:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788837505.104836:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788837505.104866:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788837505.104899:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788837505.104943:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788837505.104978:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788837505.105012:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788837505.105059:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788837505.105113:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788837505.105147:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788837505.105207:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788837505.105245:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788837505.105279:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788837505.108967:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788837505.109068:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788837505.109106:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788837505.109159:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788837505.109193:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788837505.109225:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788837505.109271:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788837505.110604:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788837505.110678:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837505.110769:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837505.110809:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708737536 00000100:00100000:2.0:1788837505.110816:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708737536 00000100:00100000:2.0:1788837505.110861:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788837505.110870:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708737536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837505.111096:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708737536:12345-0@lo:502:mount.lustre.0 Request processed in 227us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837505.111104:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788837505.111156:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837505.111178:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708737536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837505.111262:0:15874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788837505.111272:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788837505.124460:0:15885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788837505.124478:0:15885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9acb44f40000) 00000020:00000080:0.0:1788837505.124504:0:15885:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788837505.124601:0:15885:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9acb741d6800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788837505.124606:0:15885:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9acb741d6800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788837505.124609:0:15885:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9acb741d6800 3 00010000:00080000:0.0:1788837505.124641:0:15885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9acb7aded000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1788837505.126255:0:15885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788837505.126597:0:15885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788837505.126634:0:15885:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788837505.126650:0:15885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x843cbef8be30665d 00000100:00080000:0.0:1788837505.126661:0:15885:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788837505.126667:0:15885:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9acb7aded000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1788837505.126703:0:15885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb74c7aa00 x1875731708737664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788837505.126727:0:15885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788837505.126930:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837505.126934:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788837505.126936:0:8:0:(import.c:65:import_set_state_nolock()) ffff9acb45cdb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837505.126940:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1788837505.126953:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788837505.126957:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9acb45cdb000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1788837505.126971:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb48b8ea00 x1875731708737920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837505.133423:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1875731708737664:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788837505.133494:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837505.133536:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708737920:0@lo:8:kworker.0 00000100:00100000:3.0:1788837505.133558:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837505.133686:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708738176:0@lo:400:kworker.0 00000100:00100000:3.0:1788837505.133713:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837505.133732:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837505.133739:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708738048:0@lo:400:kworker.0 00000100:00100000:3.0:1788837505.133761:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837505.133799:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708737664 00000100:00100000:3.0:1788837505.133807:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708737664 00000100:00100000:3.0:1788837505.133837:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708738176 00000100:00100000:3.0:1788837505.133839:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708738176 00000100:00100000:3.0:1788837505.133870:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708738048 00000100:00100000:3.0:1788837505.133872:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708738048 00000100:00100000:3.0:1788837505.133887:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837505.133894:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708738176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837505.133947:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708738176:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.133954:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837505.133973:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837505.133979:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708738048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837505.134005:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708738048:12345-0@lo:400:kworker.0 Request processed in 26us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.134011:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837505.134023:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837505.134027:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875731708737664:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788837505.134059:0:14474:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:3.0:1788837505.134094:0:14474:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x843cbef8be306664 00000004:00100000:3.0:1788837505.134108:0:14474:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788837505.134139:0:14474:0:(import.c:65:import_set_state_nolock()) ffff9acb767e1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837505.134178:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875731708737664:12345-0@lo:38:llog_process_th.0 Request processed in 148us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.134184:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788837505.134209:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788837505.134233:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb48b8d180 x1875731708738048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837505.134247:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708738048:0@lo:400:kworker.0 00010000:00080000:3.0:1788837505.134257:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb48b8df80 x1875731708738176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837505.134267:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708738176:0@lo:400:kworker.0 00010000:00080000:3.0:1788837505.134294:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9acb74c7aa00 x1875731708737664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837505.134324:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837505.134331:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788837505.134337:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788837505.134342:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788837505.134344:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb7aded000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788837505.134349:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1875731708737664:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788837505.135428:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708737792:0@lo:400:kworker.0 00000100:00100000:0.0:1788837505.135485:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788837505.142206:0:15885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1788837505.142408:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708737920 00000100:00100000:3.0:1788837505.142417:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708737920 00000100:00100000:3.0:1788837505.142455:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708737792 00000100:00100000:3.0:1788837505.142458:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708737792 00000100:00080000:3.0:1788837505.142479:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837505.142503:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837505.142512:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1875731708737792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837505.142590:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1875731708737792:12345-0@lo:400:kworker.0 Request processed in 80us (7105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837505.142597:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837505.142635:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708737792:0@lo:400:kworker.0 00000100:00100000:3.0:1788837505.142656:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837505.142660:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3312:x1875731708737920:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788837505.142701:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3312:x1875731708737920:12345-0@lo:8:kworker.0 Request processed in 39us (9141us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788837505.142706:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837505.142726:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837505.142732:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb45cdb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837505.142736:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788837505.142739:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708737920:0@lo:8:kworker.0 00000020:01000000:3.0:1788837505.142759:0:15874:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788837505.142786:0:15874:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788837505.142797:0:15874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f542c00/0x843cbef8be306648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30664f expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837505.142807:0:15874:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f542c00/0x843cbef8be306648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be30664f expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788837505.142846:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788837505.142850:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837505.142851:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837505.142852:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837505.142854:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837505.142855:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837505.142856:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837505.142858:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837505.142859:0:15874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788837505.142862:0:15874:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788837505.142864:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788837505.142866:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837505.142867:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837505.142868:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837505.142869:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837505.142869:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837505.142870:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837505.142871:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837505.142872:0:15874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788837505.142889:0:15874:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788837505.142902:0:15874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708738304:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788837505.142938:0:15874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837505.142961:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708738304 00000100:00100000:3.0:1788837505.142964:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708738304 00000100:00100000:3.0:1788837505.142984:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788837505.142989:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:15874:x1875731708738304:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788837505.143006:0:14464:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788837505.143018:0:14464:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788837505.144231:0:15874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb46b87900 going to sleep for 11 seconds 20000000:01000000:2.0:1788837505.199756:0:14464:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788837505.199781:0:14464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788837505.199850:0:14488:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788837505.199855:0:14488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788837505.199878:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.199898:0:14488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30653e expref: 19 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.199907:0:14488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.199954:0:14488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30653e expref: 19 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.199979:0:14488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30653e expref: 19 pid: 14464 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837505.199993:0:14488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14488:1875731708738432:0@lo:104: 00000100:00100000:1.0:1788837505.200063:0:14488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837505.200106:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708738432 00000100:00100000:3.0:1788837505.200115:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708738432 00000100:00100000:1.0:1788837505.200132:0:14488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb512d7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837505.200173:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837505.200185:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:14488:x1875731708738432:12345-0@lo:104: 00010000:00010000:3.0:1788837505.200201:0:14455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837505.200342:0:14455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837505.200350:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:14488:x1875731708738432:12345-0@lo:104: Request processed in 168us (287us total) trans 0 rc 0/0 00010000:00010000:0.0:1788837505.200358:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788837505.200374:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788837505.200376:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200386:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917b200 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:0.0:1788837505.200390:0:14460:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200412:0:14460:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837505.200420:0:14460:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837505.200426:0:14460:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837505.200459:0:14460:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200465:0:14460:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837505.200485:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200492:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7917b200/0x843cbef8be30653e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306545 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200510:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837505.200512:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837505.200514:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837505.200533:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3315:1875731708738560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837505.200567:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837505.200613:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708738560 00000100:00100000:0.0:1788837505.200618:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708738560 00010000:00010000:0.0:1788837505.200635:0:14459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30653e expref: 20 pid: 14464 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837505.200677:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837505.200684:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+20:3315:x1875731708738560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837505.200700:0:14459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837505.200706:0:14459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30653e expref: 20 pid: 14464 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200720:0:14459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30653e expref: 20 pid: 14464 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200736:0:14459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200744:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788837505.200758:0:14459:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009732247s 00010000:00010000:0.0:1788837505.200763:0:14459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200770:0:14459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200776:0:14459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200782:0:14459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200787:0:14459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576c00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837505.200791:0:14459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200798:0:14459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200814:0:14459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837505.200825:0:14459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837505.200856:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+20:3315:x1875731708738560:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837505.200863:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837505.200897:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3315:1875731708738560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837505.201091:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f576600/0x843cbef8be306545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30653e expref: 19 pid: 14464 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837505.201103:0:14488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14488:1875731708738432:0@lo:104: 00010000:00010000:1.0:1788837505.201117:0:14488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.201137:0:14488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.201143:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837505.201149:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f576c00/0x843cbef8be30666b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837505.228821:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:15874:x1875731708738304:12345-0@lo:253:mount.lustre.0 Request processed in 85820us (85871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837505.228836:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788837505.228952:0:15874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fbef8f-8952-49e4-a88d-774a3e8128a4:15874:1875731708738304:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788837505.228966:0:15874:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788837505.228970:0:15874:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788837505.228971:0:15874:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837505.228973:0:15874:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837505.228974:0:15874:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837505.228975:0:15874:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837505.228976:0:15874:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837505.228978:0:15874:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837505.228980:0:15874:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837505.228981:0:15874:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788837505.228996:0:15874:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788837505.235393:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837505.235560:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837505.235723:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837505.235875:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788837505.236035:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788837505.236261:0:15874:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788837505.237980:0:15874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788837505.318413:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788837505.336989:0:15874:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788837505.336996:0:15874:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788837505.337030:0:15874:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788837505.337158:0:15874:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788837505.337175:0:15874:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788837505.337201:0:15874:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00100000:3.0:1788837506.035477:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788837506.035497:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1788837506.342467:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788837506.749964:0:14470:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788837506.749973:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9acb47ed0000 from 8 10000000:01000000:3.0:1788837506.749978:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788837506.750027:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb75237600/0x843cbef8be306672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837506.750040:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb75237600/0x843cbef8be306672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837506.750052:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb75237600/0x843cbef8be306672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837506.750091:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708738688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837506.750159:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837506.750218:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d247000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837506.750276:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708738688 00000100:00100000:0.0:1788837506.750284:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708738688 00000100:00100000:0.0:1788837506.750361:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788837506.750370:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:14470:x1875731708738688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837506.750384:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837506.750396:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb5075d200/0x843cbef8be306679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be306672 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837506.750419:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb5075d200/0x843cbef8be306679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be306672 expref: 19 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837506.750429:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb5075d200/0x843cbef8be306679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be306672 expref: 19 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837506.750437:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075d200, rc 0) 00000100:00100000:0.0:1788837506.750474:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:14470:x1875731708738688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837506.750480:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788837506.751171:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708738688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837506.751192:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb75237600/0x843cbef8be306672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306679 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837506.751201:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb75237600/0x843cbef8be306672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be306679 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837506.751261:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708738816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788837506.751324:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837506.751346:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d247000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837506.751412:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708738816 00000100:00100000:0.0:1788837506.751424:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708738816 00000100:00100000:0.0:1788837506.751466:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788837506.751474:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:14470:x1875731708738816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788837506.751489:0:14464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788837506.751505:0:14464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788837506.751508:0:14464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788837506.751593:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:14470:x1875731708738816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837506.751602:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788837506.751832:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708738816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788837506.751905:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788837506.751913:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb75237600/0x843cbef8be306672 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306679 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837506.751922:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb75237600/0x843cbef8be306672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be306679 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837506.919930:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837506.919952:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708738944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837506.920019:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837506.921026:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708738944 00000100:00100000:2.0:1788837506.921038:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708738944 00000100:00100000:2.0:1788837506.921087:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837506.921098:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708738944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837506.921141:0:15159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837506.921197:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708738944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837506.921203:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837506.922608:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788837506.922655:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708738944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837507.366396:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837508.390179:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837509.419836:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788837509.806777:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788837510.438533:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837510.501857:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837510.501865:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788837510.501869:0:37:0:(import.c:65:import_set_state_nolock()) ffff9acb45cdb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837510.501883:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9acb45cdb000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1788837510.501909:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9acb48b8df80 x1875731708739328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837510.501975:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708739200:0@lo:400:kworker.0 00000100:00100000:1.0:1788837510.502048:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837510.502128:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788837510.502134:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708739072:0@lo:400:kworker.0 00000100:00100000:1.0:1788837510.502182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837510.502210:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708739712:0@lo:400:kworker.0 00000100:00100000:1.0:1788837510.502254:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837510.502281:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708739328:0@lo:8:kworker.0 00000100:00100000:1.0:1788837510.502349:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837510.502379:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708739456:0@lo:400:kworker.0 00000100:00100000:1.0:1788837510.502407:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837510.502425:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837510.502431:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708739584:0@lo:400:kworker.0 00000100:00100000:1.0:1788837510.502464:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837510.502499:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708739200 00000100:00100000:1.0:1788837510.502508:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708739200 00000100:00100000:1.0:1788837510.502568:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708739328 00000100:00100000:1.0:1788837510.502571:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708739328 00000100:00100000:1.0:1788837510.502586:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837510.502595:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708739200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837510.502723:0:15157:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788837510.502732:0:15157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788837510.502836:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837510.502843:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1875731708739328:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788837510.502872:0:15157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1788837510.502904:0:15157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x843cbef8be306680 00002000:00100000:2.0:1788837510.502919:0:15157:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9aca43501800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113971 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788837510.502923:0:15157:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788837510.502933:0:15157:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788837510.503272:0:15157:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788837510.503296:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9aca43501000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837510.503390:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875731708739328:12345-0@lo:8:kworker.0 Request processed in 545us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837510.503397:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837510.504219:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708739200:12345-0@lo:400:kworker.0 Request processed in 1624us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837510.504228:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837510.504428:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708739072 00000100:00100000:1.0:1788837510.504435:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708739072 00000100:00100000:1.0:1788837510.504485:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788837510.504493:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3314:x1875731708739072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837510.504528:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3314:x1875731708739072:12345-0@lo:400:kworker.0 Request processed in 36us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837510.504534:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788837510.504574:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708739712 00000100:00100000:1.0:1788837510.504579:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708739712 00000100:00100000:1.0:1788837510.504780:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708739456 00000100:00100000:1.0:1788837510.504784:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708739456 00000100:00100000:1.0:1788837510.504799:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708739584 00000100:00100000:1.0:1788837510.504802:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708739584 00000100:00100000:1.0:1788837510.504816:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788837510.504823:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708739712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837510.504858:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708739712:12345-0@lo:400:kworker.0 Request processed in 35us (2603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837510.504865:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788837510.504877:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837510.504883:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708739456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837510.504915:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708739456:12345-0@lo:400:kworker.0 Request processed in 32us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837510.504921:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837510.504932:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837510.504937:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708739584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837510.504962:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708739584:12345-0@lo:400:kworker.0 Request processed in 26us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837510.504968:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788837510.504991:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837510.504995:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837510.505030:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb48b8df80 x1875731708739328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837510.505241:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708739072:0@lo:400:kworker.0 00010000:00080000:2.0:1788837510.505271:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb48b8f100 x1875731708739712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837510.505281:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708739712:0@lo:400:kworker.0 00000100:00100000:2.0:1788837510.505292:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708739200:0@lo:400:kworker.0 00000100:00080000:1.0:1788837510.506102:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788837510.506120:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788837510.506139:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788837510.506143:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9acb45cdb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788837510.506155:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788837510.506163:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1875731708739328:0@lo:8:kworker.0 00010000:00080000:1.0:1788837510.506215:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb48b8ce00 x1875731708739584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837510.506227:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708739584:0@lo:400:kworker.0 00010000:00080000:1.0:1788837510.506240:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb48b8d180 x1875731708739456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837510.506263:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708739456:0@lo:400:kworker.0 00000004:00080000:2.0:1788837510.506692:0:14496:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788837510.507102:0:14496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 464357796783ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788837510.507397:0:14497:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788837510.507423:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14497:1875731708739968:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788837510.507486:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837510.507515:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788837510.507527:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837510.507537:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708739840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837510.507563:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837510.507596:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708739840 00000100:00100000:0.0:1788837510.507602:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708739840 00000100:00100000:0.0:1788837510.507656:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837510.507665:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708739840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837510.507694:0:15159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837510.507737:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708739840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837510.507743:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788837510.507773:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837510.507799:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74c7b800 x1875731708739840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837510.507816:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708739840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837510.507842:0:15157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708739968 00000100:00100000:0.0:1788837510.507845:0:15157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708739968 00000100:00100000:0.0:1788837510.507870:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837510.507876:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14497:x1875731708739968:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788837510.519163:0:15157:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788837510.519177:0:15157:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788837510.519184:0:15157:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788837510.534766:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.534779:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535104:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.535109:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.535117:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535136:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535147:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535156:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535183:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.535197:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.535203:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535211:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075ce00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.535215:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535224:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535301:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535340:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be306687 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.535359:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.535362:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.535437:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.539130:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.539882:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.539903:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.539917:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.539925:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.539940:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.539950:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.539958:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.539975:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.539989:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.543566:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.543589:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075cc00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.543595:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.543607:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.543629:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.543657:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be30668e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.543686:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.543688:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.543690:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.544589:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.544598:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544613:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.544618:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.544625:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544637:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544647:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544655:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544675:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.544690:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.544702:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544711:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d800 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.544716:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544724:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544740:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544748:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be306695 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.544768:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.544770:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.544771:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.545954:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.545966:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.545980:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.545984:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.545990:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.546080:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.546091:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.546100:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.546124:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.546140:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.546146:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.546153:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.546158:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.546166:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.546183:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.546191:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be30669c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.546216:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.546218:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.546220:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.547219:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.547229:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547245:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.547249:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.547256:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547269:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547278:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547286:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547334:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.547346:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.547351:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547537:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.547543:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547551:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547567:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547575:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.547592:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.547594:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.547596:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.548273:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.548282:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548294:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.548297:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.548321:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548343:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548357:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548437:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548455:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.548465:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.548469:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548476:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075de00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.548479:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548486:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548498:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548505:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.548521:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.548529:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.548531:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.549188:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.549194:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549205:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.549208:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.549213:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549222:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549230:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549236:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549252:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.549261:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.549267:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549274:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c800 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.549277:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549296:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549335:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549343:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.549356:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.549358:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.549360:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.550135:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.550143:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550154:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.550158:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.550163:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550173:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550183:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550198:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550215:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.550226:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.550230:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550238:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.550242:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550249:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550263:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550269:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.550285:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.550288:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.550290:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.556472:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.556496:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556514:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.556518:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.556525:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556539:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556550:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556557:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556575:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.556589:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.556594:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556601:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d600 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.556605:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556614:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556638:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556645:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.556667:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.556669:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.556671:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.558085:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.558095:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558109:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.558113:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.558119:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558131:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558141:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558149:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558184:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.558199:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.558204:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558212:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.558217:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558225:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558243:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558250:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.558268:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.558270:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.558271:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.558785:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.561228:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.561245:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.561261:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.561268:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.561282:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.561293:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.561300:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.563410:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837510.563541:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837510.563552:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.563567:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837510.563572:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.563583:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.563682:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.563704:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d04fa27f/0x843cbef8be3066cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.563736:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.563739:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.563742:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.564060:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.564068:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564082:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.564087:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.564093:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564104:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564113:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564128:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564143:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.564156:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.564160:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564168:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.564172:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564181:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564191:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564198:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be3066d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564215:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.564217:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.564219:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.564735:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.564749:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564760:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.564764:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.564768:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564779:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564786:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564794:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564810:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.564820:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.564826:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564833:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d600 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.564836:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564843:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564864:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564871:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.564891:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.564893:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.564897:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.565416:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.565424:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.565434:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.565438:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.565443:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.565454:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.565463:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.565471:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.565504:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837510.565559:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837510.565566:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.565577:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837510.565582:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.565590:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.565616:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.565624:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ee2141/0x843cbef8be3066e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.565648:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.565652:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.565654:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.565984:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.565991:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.566001:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.566004:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.566009:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.566020:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.566028:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.566035:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.566065:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:1.0:1788837510.566108:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788837510.566376:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837510.566382:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.566389:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c800 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837510.566393:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.566400:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.566413:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.566420:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a09442d/0x843cbef8be3066e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.566435:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.566436:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.566438:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.572444:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.572456:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.572475:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.572489:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.572496:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.572515:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.572526:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.572533:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.572563:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837510.574070:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.574084:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574103:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.574107:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.574113:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574127:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574139:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574156:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574178:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788837510.574193:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837510.574200:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574209:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.574213:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574222:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574239:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574245:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be3066f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574262:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.574265:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574281:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075de00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.574284:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574291:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574300:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574345:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be3066f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.574359:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.574361:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.574873:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.575186:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.576671:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.576682:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.576697:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.576702:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.576708:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.576720:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.576738:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.576746:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.576763:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837510.577005:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837510.577013:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.577023:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d600 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837510.577028:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.577050:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.577068:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.577076:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d4a40c/0x843cbef8be3066fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.577095:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.577097:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.577098:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.577965:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.577974:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.577987:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.577991:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.578088:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578100:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578109:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578116:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578147:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.578161:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.578165:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578173:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d400 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.578178:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578185:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578199:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578205:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5a707b5/0x843cbef8be306705 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578223:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.578225:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.578226:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.578968:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.578976:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.578988:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.579290:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.579296:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.579340:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.579349:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.579356:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.579387:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.579402:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.579408:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.579415:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d800 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.579418:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.579426:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.579440:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.579460:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a995082/0x843cbef8be30670c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.579478:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.579479:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.579482:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.580123:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.580130:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580142:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.580146:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.580151:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580163:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580172:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580179:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580202:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837510.580685:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.580700:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580711:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.580714:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.580719:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580729:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580737:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580743:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580759:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788837510.580770:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837510.580775:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.580782:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075cc00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.580785:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581037:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581063:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581071:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53589e0/0x843cbef8be306713 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581095:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.581098:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581104:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075ce00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.581108:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581114:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581123:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581129:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e266be2b/0x843cbef8be30671a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581139:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.581141:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.581149:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.581753:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.581760:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.581770:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.581773:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.581779:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837510.582394:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.583760:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.583781:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.584280:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.584320:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.584347:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.584352:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.584361:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075da00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.584375:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.584398:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.584421:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.584429:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4790bdf/0x843cbef8be306721 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.584454:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.584456:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.584458:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.585138:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.585146:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585160:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.585164:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.585170:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585182:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585192:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585210:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585226:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.585238:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.585242:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585249:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075ca00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.585252:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585259:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585271:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585277:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c2f3769/0x843cbef8be306728 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585291:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.585293:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.585294:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.585781:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.585796:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585805:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.585809:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.585813:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585823:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585830:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585836:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.585851:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837510.586272:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.586278:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586286:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.586289:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.586293:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586335:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586350:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586356:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586369:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788837510.586381:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837510.586385:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586392:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075de00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.586397:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586405:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586418:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586425:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bdfda36/0x843cbef8be30672f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586440:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.586449:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586456:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.586459:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586467:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586477:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586483:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099a9f62c/0x843cbef8be306736 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.586497:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.586499:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.586500:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.586990:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.586998:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587010:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.587013:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.587018:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587039:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587048:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587055:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587069:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.587079:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.587084:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587091:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075dc00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.587094:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587101:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587112:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587118:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c5bee5/0x843cbef8be30673d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.587141:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.587143:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.587145:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837510.587693:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837510.589318:0:15157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788837510.592910:0:15157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.592936:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788837510.592941:0:15157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837510.592948:0:15157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.592963:0:15157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.592974:0:15157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.592981:0:15157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.593002:0:15157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837510.593018:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837510.593023:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.593044:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c200 already unused, calling callback (ffffffffc1558420) 00010000:00010000:0.0:1788837510.593049:0:15695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.593059:0:15695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.593076:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.593084:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000162df5d7/0x843cbef8be306744 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837510.593114:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.593116:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837510.593118:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788837510.593517:0:15157:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788837510.593616:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14497:x1875731708739968:12345-0@lo:5:osp-pre-1-0.0 Request processed in 85736us (86125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837510.593626:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837510.593685:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14497:1875731708739968:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788837510.593699:0:14497:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788837510.593743:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14497:1875731708740096:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788837510.593778:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837510.593975:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788837510.594159:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708740096 00000100:00100000:0.0:1788837510.594167:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708740096 00000100:00100000:0.0:1788837510.594215:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837510.594223:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14497:x1875731708740096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788837510.594258:0:15158:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788837510.612559:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14497:x1875731708740096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18329us (18772us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788837510.612572:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837510.612630:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14497:1875731708740096:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788837510.612645:0:14497:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:1.0:1788837510.634897:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788837511.462708:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837512.040530:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837512.040554:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708740224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837512.040631:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837512.044297:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708740224 00000100:00100000:1.0:1788837512.044336:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708740224 00000100:00100000:1.0:1788837512.044405:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837512.044414:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708740224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837512.044454:0:15159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837512.044547:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708740224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (3915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837512.044555:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788837512.044577:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837512.044620:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708740224:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788837512.486039:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837513.154942:0:16234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788837513.510390:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837514.534529:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837515.509135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837515.509238:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688824832 00000100:00100000:3.0:1788837515.509248:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688824832 00000100:00100000:3.0:1788837515.509334:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:3.0:1788837515.509343:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1875731688824832:12345-192.168.203.43@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788837515.509388:0:14466:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4bdc0019-41b5-48db-a629-7682141160f9@192.168.203.43@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1788837515.509425:0:14466:0:(genops.c:1385:class_connect()) connect: client 4bdc0019-41b5-48db-a629-7682141160f9, cookie 0x843cbef8be30674b 00000100:00080000:3.0:1788837515.509587:0:14466:0:(import.c:65:import_set_state_nolock()) ffff9acb767e2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837515.509662:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+5:2357:x1875731688824832:12345-192.168.203.43@tcp:250:mount.lustre.0 Request processed in 318us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837515.509669:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:2.0:1788837515.520422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837515.521374:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688824960 00000100:00100000:0.0:1788837515.521388:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688824960 00000100:00100000:0.0:1788837515.521451:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:0.0:1788837515.521460:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+5:13781:x1875731688824960:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788837515.521478:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837515.521495:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb5075d400/0x843cbef8be306752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbe28 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837515.521527:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb5075d400/0x843cbef8be306752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe28 expref: 6 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837515.521538:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb5075d400/0x843cbef8be306752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe28 expref: 6 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837515.521547:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075d400, rc 0) 00000100:00100000:0.0:1788837515.521611:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+6:13781:x1875731688824960:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 151us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837515.521630:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:0.0:1788837515.525737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837515.525829:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688825088 00000100:00100000:1.0:1788837515.525839:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688825088 00000100:00100000:1.0:1788837515.525894:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:1.0:1788837515.525920:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+6:13781:x1875731688825088:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788837515.526421:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+6:13781:x1875731688825088:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 500us (691us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837515.526430:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:2.0:1788837515.534684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837515.534781:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688825216 00000100:00100000:3.0:1788837515.534792:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688825216 00000100:00100000:3.0:1788837515.534847:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:3.0:1788837515.534856:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+6:13781:x1875731688825216:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788837515.534874:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837515.534891:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75237c00/0x843cbef8be306759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbe2f expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.534921:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75237c00/0x843cbef8be306759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe2f expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.534933:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75237c00/0x843cbef8be306759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe2f expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.534943:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237c00, rc 0) 00000100:00100000:3.0:1788837515.535004:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+7:13781:x1875731688825216:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 149us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837515.535010:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:2.0:1788837515.543739:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837515.543839:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688825344 00000100:00100000:0.0:1788837515.543850:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688825344 00000100:00100000:0.0:1788837515.543907:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:0.0:1788837515.543917:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+7:13781:x1875731688825344:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788837515.544364:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+8:13781:x1875731688825344:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 447us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837515.544372:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:0.0:1788837515.551660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837515.551751:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688825472 00000100:00100000:1.0:1788837515.551760:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688825472 00000100:00100000:1.0:1788837515.551814:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:1.0:1788837515.551825:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+8:13781:x1875731688825472:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788837515.552050:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+8:13781:x1875731688825472:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 225us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837515.552058:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:2.0:1788837515.560892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837515.560970:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688825600 00000100:00100000:0.0:1788837515.560981:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688825600 00000100:00100000:0.0:1788837515.561034:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:0.0:1788837515.561045:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+8:13799:x1875731688825600:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837515.561343:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+8:13799:x1875731688825600:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 300us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837515.561351:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00010000:00010000:1.0:1788837515.565651:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837515.589971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837515.590079:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688825728 00000100:00100000:3.0:1788837515.590089:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688825728 00000100:00100000:3.0:1788837515.590142:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:3.0:1788837515.590158:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+8:13799:x1875731688825728:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837515.590486:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+8:13799:x1875731688825728:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 328us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837515.590494:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:2.0:1788837515.599218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837515.599346:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688825856 00000100:00100000:3.0:1788837515.599357:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688825856 00000100:00100000:3.0:1788837515.599418:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:3.0:1788837515.599429:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb741ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+8:13781:x1875731688825856:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788837515.599447:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837515.599466:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75237000/0x843cbef8be306760 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbe59 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.599501:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75237000/0x843cbef8be306760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe59 expref: 9 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.599513:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75237000/0x843cbef8be306760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe59 expref: 9 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.599523:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237000, rc 0) 00000100:00100000:3.0:1788837515.599584:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb741ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+9:13781:x1875731688825856:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 157us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837515.599592:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:2.0:1788837515.611197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837515.611371:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688825984 00000100:00100000:0.0:1788837515.611388:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688825984 00000100:00100000:0.0:1788837515.611445:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:0.0:1788837515.611455:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+9:13781:x1875731688825984:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788837515.611488:0:14464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788837515.611522:0:14464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788837515.611529:0:14464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788837515.611535:0:14464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788837515.611548:0:14464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788837515.616942:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+9:13781:x1875731688825984:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 5477us (5743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837515.616958:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:0.0:1788837515.625186:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708740736:0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.625258:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837515.625349:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788837515.625356:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3315:1875731708740352:0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.625384:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837515.625408:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708740864:0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.625430:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837515.625454:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708740480:0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.625478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837515.625495:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708740992:0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.625518:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837515.625537:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837515.625542:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708740608:0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.625561:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837515.625591:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708740736 00000100:00100000:0.0:1788837515.625598:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708740736 00000100:00100000:0.0:1788837515.625639:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708740864 00000100:00100000:0.0:1788837515.625642:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708740864 00000100:00100000:0.0:1788837515.625663:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708740992 00000100:00100000:0.0:1788837515.625668:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708740992 00000100:00100000:0.0:1788837515.625683:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837515.625691:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708740736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.625741:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708740736:12345-0@lo:400:kworker.0 Request processed in 51us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837515.625762:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837515.625781:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837515.625786:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708740864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.625814:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708740864:12345-0@lo:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837515.625819:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837515.625829:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837515.625834:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708740992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.625862:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875731708740992:12345-0@lo:400:kworker.0 Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837515.625867:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788837515.625891:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788837515.625917:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74e58380 x1875731708740992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837515.625932:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1875731708740992:0@lo:400:kworker.0 00010000:00080000:0.0:1788837515.625959:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74e5b800 x1875731708740864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837515.625969:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708740864:0@lo:400:kworker.0 00010000:00080000:0.0:1788837515.625979:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9acb74e59180 x1875731708740736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837515.625987:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708740736:0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.626006:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708740352 00000100:00100000:0.0:1788837515.626009:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708740352 00000100:00100000:0.0:1788837515.626039:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788837515.626045:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3315:x1875731708740352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.626082:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3315:x1875731708740352:12345-0@lo:400:kworker.0 Request processed in 36us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837515.626088:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788837515.626119:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3315:1875731708740352:0@lo:400:kworker.0 00000100:00100000:2.0:1788837515.626341:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708740480 00000100:00100000:2.0:1788837515.626346:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708740480 00000100:00100000:2.0:1788837515.626378:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708740608 00000100:00100000:2.0:1788837515.626380:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708740608 00000100:00100000:2.0:1788837515.626398:0:16099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837515.626404:0:16099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708740480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837515.626439:0:16099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875731708740480:12345-0@lo:400:kworker.0 Request processed in 35us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837515.626444:0:16099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837515.626457:0:16099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837515.626463:0:16099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708740608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837515.626490:0:16099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875731708740608:12345-0@lo:400:kworker.0 Request processed in 27us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837515.626497:0:16099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788837515.626514:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837515.626517:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837515.627390:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837515.627416:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688826112 00000100:00100000:3.0:1788837515.627422:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688826112 00000100:00100000:3.0:1788837515.627453:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:3.0:1788837515.627462:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+9:13781:x1875731688826112:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788837515.627482:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837515.627500:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbe60 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.627526:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe60 expref: 10 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.627540:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe60 expref: 10 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.627549:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237800, rc 0) 00000100:00100000:3.0:1788837515.627597:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+10:13781:x1875731688826112:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 136us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837515.627604:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:0.0:1788837515.630880:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708741120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837515.630959:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837515.631042:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708740608:0@lo:400:kworker.0 00000100:00100000:0.0:1788837515.631055:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74c78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1875731708740480:0@lo:400:kworker.0 00000100:00100000:1.0:1788837515.631173:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708741120 00000100:00100000:1.0:1788837515.631181:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708741120 00000100:00100000:1.0:1788837515.631231:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837515.631241:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875731708741120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837515.631275:0:15159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837515.631367:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875731708741120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837515.631374:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837515.631607:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708741120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837515.637495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837515.637533:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688826240 00000100:00100000:2.0:1788837515.637542:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688826240 00000100:00100000:2.0:1788837515.637596:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:2.0:1788837515.637606:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+10:13781:x1875731688826240:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788837515.637874:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+10:13781:x1875731688826240:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 268us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837515.637882:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:3.0:1788837515.644778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837515.649334:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688826368 00000100:00100000:2.0:1788837515.649355:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688826368 00000100:00100000:2.0:1788837515.650165:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:2.0:1788837515.650177:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+10:13781:x1875731688826368:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788837515.650423:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+10:13781:x1875731688826368:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 247us (5652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837515.650432:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:3.0:1788837515.658945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837515.659876:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688826496 00000100:00100000:2.0:1788837515.659889:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688826496 00000100:00100000:2.0:1788837515.659936:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:2.0:1788837515.659945:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+10:13803:x1875731688826496:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837515.660164:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+10:13803:x1875731688826496:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 218us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837515.660172:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:0.0:1788837515.675849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837515.675935:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688826624 00000100:00100000:2.0:1788837515.675945:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688826624 00000100:00100000:2.0:1788837515.675999:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:2.0:1788837515.676010:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+10:13803:x1875731688826624:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837515.676245:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+10:13803:x1875731688826624:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 236us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837515.676253:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:2.0:1788837515.692745:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837515.697347:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688826752 00000100:00100000:3.0:1788837515.697362:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688826752 00000100:00100000:3.0:1788837515.697413:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1788837515.697421:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875731688826752:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788837515.697452:0:14474:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8299b52c-6950-430e-a077-88f6eaaeff37@192.168.203.43@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1788837515.697496:0:14474:0:(genops.c:1385:class_connect()) connect: client 8299b52c-6950-430e-a077-88f6eaaeff37, cookie 0x843cbef8be30676e 00000004:00100000:3.0:1788837515.697524:0:14474:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788837515.697530:0:14474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788837515.736502:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00080000:3.0:1788837515.744946:0:14474:0:(import.c:65:import_set_state_nolock()) ffff9acb767e6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837515.745046:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+6:2357:x1875731688826752:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 47622us (52310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837515.745072:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1788837515.747784:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837515.747825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837515.747915:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688826880 00000100:00100000:2.0:1788837515.747927:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688827008 00000100:00100000:1.0:1788837515.747927:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688826880 00000100:00100000:2.0:1788837515.747931:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688827008 00000100:00100000:2.0:1788837515.747988:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00080000:0.0:1788837515.747996:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837515.747999:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+7:13781:x1875731688827008:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788837515.748059:0:15691:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788837515.748153:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+7:13781:x1875731688827008:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 155us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837515.748160:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1788837515.748193:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1788837515.748201:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+6:0:x1875731688826880:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788837515.748213:0:15691:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788837515.748235:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+6:0:x1875731688826880:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837515.748242:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1788837515.752426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837515.752509:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688827136 00000100:00100000:1.0:1788837515.752519:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688827136 00000100:00100000:1.0:1788837515.752572:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1788837515.752583:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+6:13781:x1875731688827136:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788837515.752681:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+6:13781:x1875731688827136:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 99us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837515.752689:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1788837515.755448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837515.755557:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688827520 00000100:00100000:1.0:1788837515.755567:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688827520 00000100:00100000:1.0:1788837515.755623:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1788837515.755634:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8299b52c-6950-430e-a077-88f6eaaeff37+6:13781:x1875731688827520:12345-192.168.203.43@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788837515.755915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837515.755947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000004:00080000:1.0:1788837515.756569:0:14475:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 872us 00000100:00100000:3.0:1788837515.758906:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688827264 00000100:00100000:3.0:1788837515.758919:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688827264 00000100:00100000:3.0:1788837515.758959:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688827392 00000100:00100000:3.0:1788837515.758962:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688827392 00000100:00100000:3.0:1788837515.758990:0:16099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1788837515.758999:0:16099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875731688827264:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788837515.759030:0:16099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8299b52c-6950-430e-a077-88f6eaaeff37@192.168.203.43@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1788837515.759061:0:16099:0:(genops.c:1385:class_connect()) connect: client 8299b52c-6950-430e-a077-88f6eaaeff37, cookie 0x843cbef8be306775 00002000:00100000:3.0:1788837515.759075:0:16099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8299b52c-6950-430e-a077-88f6eaaeff37/ffff9acb767e0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788837515.759097:0:16099:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788837515.759405:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1788837515.759412:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875731688827392:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788837515.759429:0:15157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8299b52c-6950-430e-a077-88f6eaaeff37@192.168.203.43@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:2.0:1788837515.759447:0:15157:0:(genops.c:1385:class_connect()) connect: client 8299b52c-6950-430e-a077-88f6eaaeff37, cookie 0x843cbef8be30677c 00002000:00100000:2.0:1788837515.759452:0:15157:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8299b52c-6950-430e-a077-88f6eaaeff37/ffff9aca43505800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788837515.759458:0:15157:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788837515.759565:0:16099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788837515.759599:0:16099:0:(import.c:65:import_set_state_nolock()) ffff9acb767e0000 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1788837515.759662:0:15157:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1788837515.759672:0:16099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8299b52c-6950-430e-a077-88f6eaaeff37+6:2357:x1875731688827264:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 673us (3758us total) trans 0 rc 0/0 00000100:00080000:2.0:1788837515.759677:0:15157:0:(import.c:65:import_set_state_nolock()) ffff9aca43500800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837515.759679:0:16099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1788837515.759700:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8299b52c-6950-430e-a077-88f6eaaeff37+6:2357:x1875731688827392:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 287us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837515.759707:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000004:00200000:1.0:1788837515.774522:0:14475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788837515.774682:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8299b52c-6950-430e-a077-88f6eaaeff37+6:13781:x1875731688827520:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 19044us (19236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837515.774692:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1788837515.971832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837515.971923:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688827648 00000100:00100000:3.0:1788837515.971932:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688827648 00000100:00100000:3.0:1788837515.971991:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1788837515.972001:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+6:13824:x1875731688827648:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:3.0:1788837515.972021:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837515.972047:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbe8a expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.972113:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be30678a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.972142:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be30678a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.972174:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be30678a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837515.972221:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788837515.972225:0:14472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837515.972263:0:14472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be30678a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.972301:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe8a expref: 8 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.972350:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be30678a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe8a expref: 7 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837515.972359:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb4556d200) 00010000:00010000:3.0:1788837515.972362:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837515.972366:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236200, rc 0) 00000100:00100000:3.0:1788837515.972437:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+7:13824:x1875731688827648:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 436us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837515.972444:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000001:00100000:1.0:1788837516.181589:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8299b52c-6950-430e-a077-88f6eaaeff37 00010000:00010000:2.0:1788837516.582038:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837517.157801:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708741248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837517.157876:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837517.158150:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708741248 00000100:00100000:2.0:1788837517.158159:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708741248 00000100:00100000:2.0:1788837517.158237:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837517.158249:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708741248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837517.158294:0:15159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837517.158382:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708741248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837517.158389:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788837517.158585:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837517.158620:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708741248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837517.606268:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837518.208866:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837518.208955:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688827776 00000100:00100000:1.0:1788837518.208965:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688827776 00000100:00100000:1.0:1788837518.209040:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1788837518.209051:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+7:13877:x1875731688827776:12345-192.168.203.43@tcp:41:lfs.0 00000004:00000024:1.0:1788837518.209092:0:14473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788837518.209342:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837518.209569:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+7:13877:x1875731688827776:12345-192.168.203.43@tcp:41:lfs.0 Request processed in 517us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837518.209578:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1788837518.223573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837518.223689:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688827904 00000100:00100000:2.0:1788837518.223699:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688827904 00000100:00100000:2.0:1788837518.223776:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1788837518.223786:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8299b52c-6950-430e-a077-88f6eaaeff37+5:13877:x1875731688827904:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:2.0:1788837518.223812:0:15159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788837518.224339:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837518.225668:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8299b52c-6950-430e-a077-88f6eaaeff37+5:13877:x1875731688827904:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 1874us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.225681:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1788837518.229282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837518.230346:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688828032 00000100:00100000:1.0:1788837518.230358:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688828032 00000100:00100000:1.0:1788837518.230436:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00080000:0.0:1788837518.230653:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837518.230756:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8299b52c-6950-430e-a077-88f6eaaeff37+6:13877:x1875731688828032:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:1.0:1788837518.230810:0:15160:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837518.230997:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8299b52c-6950-430e-a077-88f6eaaeff37+6:13877:x1875731688828032:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 246us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837518.231005:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1788837518.508550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837518.508661:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688828160 00000100:00100000:2.0:1788837518.508670:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688828160 00000100:00100000:2.0:1788837518.508731:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:2.0:1788837518.508742:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+10:13907:x1875731688828160:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788837518.508758:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837518.508776:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f543800/0x843cbef8be306791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbe91 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837518.508828:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f543800/0x843cbef8be306791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe91 expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837518.508852:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f543800/0x843cbef8be306791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe91 expref: 11 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837518.508861:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543800, rc 0) 00000100:00100000:2.0:1788837518.508922:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+11:13907:x1875731688828160:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 182us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.508929:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:0.0:1788837518.514997:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837518.515157:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688828288 00000100:00100000:3.0:1788837518.515165:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688828288 00000100:00100000:3.0:1788837518.515226:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:3.0:1788837518.515236:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7a83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+11:13907:x1875731688828288:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788837518.515676:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7a83c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+11:13907:x1875731688828288:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 439us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837518.515684:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:3.0:1788837518.521742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837518.522333:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688828416 00000100:00100000:0.0:1788837518.522343:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688828416 00000100:00100000:0.0:1788837518.522398:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:0.0:1788837518.522408:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+11:13907:x1875731688828416:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788837518.522714:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+11:13907:x1875731688828416:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 306us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837518.522722:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:0.0:1788837518.539636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837518.542977:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688828544 00000100:00100000:2.0:1788837518.542992:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688828544 00000100:00100000:2.0:1788837518.543046:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:2.0:1788837518.543055:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+11:13915:x1875731688828544:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837518.544020:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+11:13915:x1875731688828544:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 961us (4390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.544030:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:1.0:1788837518.587894:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837518.589501:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688828672 00000100:00100000:3.0:1788837518.589523:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688828672 00000100:00100000:3.0:1788837518.589583:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:3.0:1788837518.589593:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+11:13915:x1875731688828672:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837518.590109:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+11:13915:x1875731688828672:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 515us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837518.590117:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:3.0:1788837518.611034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837518.611193:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688828800 00000100:00100000:2.0:1788837518.611202:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688828800 00000100:00100000:2.0:1788837518.611254:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:2.0:1788837518.611264:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb46952c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+11:13907:x1875731688828800:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788837518.611288:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837518.611339:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f543e00/0x843cbef8be306798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbebb expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837518.611366:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f543e00/0x843cbef8be306798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbebb expref: 12 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837518.611391:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f543e00/0x843cbef8be306798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbebb expref: 12 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837518.611400:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543e00, rc 0) 00000100:00100000:2.0:1788837518.611471:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb46952c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+12:13907:x1875731688828800:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 208us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.611478:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:1.0:1788837518.616393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837518.616486:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688828928 00000100:00100000:0.0:1788837518.616496:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688828928 00000100:00100000:0.0:1788837518.616555:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:0.0:1788837518.616565:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+12:13907:x1875731688828928:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788837518.616591:0:14467:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788837518.616615:0:14467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788837518.616619:0:14467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788837518.616622:0:14467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788837518.616624:0:14467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788837518.634141:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+12:13907:x1875731688828928:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 17565us (17744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.634154:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 96 00010000:00010000:1.0:1788837518.634436:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837518.639392:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837518.639532:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688829056 00000100:00100000:2.0:1788837518.639543:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688829056 00000100:00100000:2.0:1788837518.639596:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:2.0:1788837518.639606:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+12:13907:x1875731688829056:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788837518.639622:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837518.639639:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbec2 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837518.639678:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbec2 expref: 13 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837518.639688:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbec2 expref: 13 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837518.639696:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543400, rc 0) 00000100:00100000:2.0:1788837518.639762:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+13:13907:x1875731688829056:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 151us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.639784:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:0.0:1788837518.644220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837518.644360:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688829184 00000100:00100000:2.0:1788837518.644369:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688829184 00000100:00100000:2.0:1788837518.644427:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:2.0:1788837518.644438:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+13:13907:x1875731688829184:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788837518.644962:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+13:13907:x1875731688829184:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 524us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.644971:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:1.0:1788837518.651188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837518.651301:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688829312 00000100:00100000:0.0:1788837518.651340:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688829312 00000100:00100000:0.0:1788837518.651394:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:0.0:1788837518.651406:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+13:13907:x1875731688829312:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788837518.652735:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+13:13907:x1875731688829312:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 1326us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837518.652745:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:0.0:1788837518.656917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837518.657206:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688829440 00000100:00100000:2.0:1788837518.657215:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688829440 00000100:00100000:2.0:1788837518.657261:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:2.0:1788837518.657279:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+13:13918:x1875731688829440:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837518.659280:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+13:13918:x1875731688829440:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 1993us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.659293:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:1.0:1788837518.665393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837518.667706:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688829568 00000100:00100000:0.0:1788837518.667722:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688829568 00000100:00100000:0.0:1788837518.667790:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:0.0:1788837518.667806:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+13:13918:x1875731688829568:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837518.668055:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+13:13918:x1875731688829568:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 255us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837518.668062:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:1.0:1788837518.674869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837518.675138:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688829696 00000100:00100000:3.0:1788837518.675159:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688829696 00000100:00100000:3.0:1788837518.675208:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1788837518.675216:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1875731688829696:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788837518.675245:0:14472:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c584049e-bfe6-4eea-8738-57e610314e70@192.168.203.43@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1788837518.675291:0:14472:0:(genops.c:1385:class_connect()) connect: client c584049e-bfe6-4eea-8738-57e610314e70, cookie 0x843cbef8be3067a6 00000004:00100000:3.0:1788837518.675345:0:14472:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788837518.675476:0:14472:0:(import.c:65:import_set_state_nolock()) ffff9acb46ac5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837518.675549:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+6:2357:x1875731688829696:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 332us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837518.675557:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1788837518.691152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837518.691288:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688829952 00000100:00100000:3.0:1788837518.691407:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688829952 00000100:00100000:2.0:1788837518.700783:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:2.0:1788837518.700798:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c584049e-bfe6-4eea-8738-57e610314e70+6:13907:x1875731688829952:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788837518.700831:0:14474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788837518.700919:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c584049e-bfe6-4eea-8738-57e610314e70+6:13907:x1875731688829952:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 124us (9775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.700926:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00080000:0.0:1788837518.701417:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837518.708850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837518.709347:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688829824 00000100:00100000:3.0:1788837518.709357:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688829824 00000100:00100000:3.0:1788837518.709408:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1788837518.709420:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+6:0:x1875731688829824:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788837518.709465:0:14472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788837518.709550:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+6:0:x1875731688829824:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 132us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837518.709558:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1788837518.712046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837518.712557:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688830080 00000100:00100000:2.0:1788837518.712568:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688830080 00000100:00100000:2.0:1788837518.712629:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1788837518.712654:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c584049e-bfe6-4eea-8738-57e610314e70+6:13907:x1875731688830080:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788837518.712746:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c584049e-bfe6-4eea-8738-57e610314e70+6:13907:x1875731688830080:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 94us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837518.712755:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1788837518.725235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837518.725285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837518.725361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837518.725464:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688830464 00000100:00100000:3.0:1788837518.725475:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688830464 00000100:00100000:3.0:1788837518.725531:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1788837518.725542:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c584049e-bfe6-4eea-8738-57e610314e70+6:13907:x1875731688830464:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788837518.725615:0:14476:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788837518.725693:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c584049e-bfe6-4eea-8738-57e610314e70+6:13907:x1875731688830464:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 152us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837518.725700:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:0.0:1788837518.726062:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688830208 00000100:00100000:0.0:1788837518.726068:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688830208 00000100:00100000:0.0:1788837518.726097:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688830336 00000100:00100000:0.0:1788837518.726100:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688830336 00000100:00100000:0.0:1788837518.726122:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1788837518.726128:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875731688830208:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788837518.726153:0:15158:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c584049e-bfe6-4eea-8738-57e610314e70@192.168.203.43@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1788837518.726186:0:15158:0:(genops.c:1385:class_connect()) connect: client c584049e-bfe6-4eea-8738-57e610314e70, cookie 0x843cbef8be3067ad 00002000:00100000:0.0:1788837518.726198:0:15158:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c584049e-bfe6-4eea-8738-57e610314e70/ffff9acb79832000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788837518.726210:0:15158:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788837518.726494:0:15158:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788837518.726531:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9acb46aba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837518.726578:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c584049e-bfe6-4eea-8738-57e610314e70+6:2357:x1875731688830208:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 449us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837518.726586:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1788837518.726604:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1788837518.726609:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875731688830336:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788837518.726640:0:15158:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c584049e-bfe6-4eea-8738-57e610314e70@192.168.203.43@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1788837518.726656:0:15158:0:(genops.c:1385:class_connect()) connect: client c584049e-bfe6-4eea-8738-57e610314e70, cookie 0x843cbef8be3067b4 00002000:00100000:0.0:1788837518.726661:0:15158:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c584049e-bfe6-4eea-8738-57e610314e70/ffff9acb46abf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113971 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788837518.726668:0:15158:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788837518.726721:0:15158:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788837518.726736:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9acb46abd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837518.726766:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c584049e-bfe6-4eea-8738-57e610314e70+6:2357:x1875731688830336:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 150us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837518.726773:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1788837518.907673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837518.907757:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688830592 00000100:00100000:3.0:1788837518.907769:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688830592 00000100:00100000:3.0:1788837518.907838:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:3.0:1788837518.907848:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+6:13939:x1875731688830592:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:3.0:1788837518.907868:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837518.907889:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3067bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbeec expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837518.907954:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837518.907981:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837518.907992:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837518.908028:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788837518.908032:0:14472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837518.908052:0:14472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837518.908076:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3067bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbeec expref: 8 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837518.908095:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbeec expref: 7 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837518.908104:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb4556d200) 00010000:00010000:3.0:1788837518.908107:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837518.908110:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236c00, rc 0) 00000100:00100000:3.0:1788837518.908184:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+7:13939:x1875731688830592:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 337us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837518.908191:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000040:00080000:0.0:1788837519.014262:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788837519.653506:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837520.681477:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837520.743235:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708741376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837520.743644:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837520.743823:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708741376 00000100:00100000:2.0:1788837520.743832:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708741376 00000100:00100000:2.0:1788837520.743961:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837520.743974:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708741376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837520.744010:0:15160:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837520.744061:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708741376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837520.744068:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788837520.744110:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837520.744419:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788837520.744440:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708741376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837520.752475:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708741760:0@lo:400:kworker.0 00000100:00100000:2.0:1788837520.752541:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837520.752581:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837520.752587:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708741888:0@lo:400:kworker.0 00000100:00100000:2.0:1788837520.752612:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837520.752641:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708741760 00000100:00100000:2.0:1788837520.752649:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708741760 00000100:00100000:2.0:1788837520.752705:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708741888 00000100:00100000:2.0:1788837520.752708:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708741888 00000100:00100000:2.0:1788837520.752752:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837520.752761:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708741760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837520.752811:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708741760:12345-0@lo:400:kworker.0 Request processed in 50us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837520.752818:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837520.752837:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837520.752843:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708741888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837520.752870:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708741888:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837520.752876:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837520.752912:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708741888:0@lo:400:kworker.0 00000100:00100000:2.0:1788837520.752923:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708741760:0@lo:400:kworker.0 00000100:00080000:2.0:1788837520.752945:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837520.755611:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708741632:0@lo:400:kworker.0 00000100:00100000:3.0:1788837520.755681:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837520.755730:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788837520.755737:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708741504:0@lo:400:kworker.0 00000100:00100000:3.0:1788837520.755774:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837520.755798:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708742016:0@lo:400:kworker.0 00000100:00100000:3.0:1788837520.755821:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837520.755849:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708741504 00000100:00100000:3.0:1788837520.755856:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708741504 00000100:00100000:3.0:1788837520.755898:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788837520.755907:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3314:x1875731708741504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837520.755954:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3314:x1875731708741504:12345-0@lo:400:kworker.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837520.755962:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788837520.756022:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708742016 00000100:00100000:3.0:1788837520.756026:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708742016 00000100:00100000:3.0:1788837520.756058:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788837520.756065:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708742016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837520.756097:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708742016:12345-0@lo:400:kworker.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837520.756104:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788837520.756135:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708741504:0@lo:400:kworker.0 00000100:00100000:3.0:1788837520.756151:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708742016:0@lo:400:kworker.0 00000100:00080000:3.0:1788837520.756622:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837520.756683:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708741632 00000100:00100000:3.0:1788837520.756688:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708741632 00000100:00100000:3.0:1788837520.756731:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837520.756740:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708741632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837520.756779:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708741632:12345-0@lo:400:kworker.0 Request processed in 42us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837520.756793:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788837520.756808:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837520.765298:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708741632:0@lo:400:kworker.0 00000001:00100000:2.0:1788837520.808393:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c584049e-bfe6-4eea-8738-57e610314e70 00000001:00100000:2.0:1788837520.808408:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8299b52c-6950-430e-a077-88f6eaaeff37 00000001:00100000:1.0:1788837520.839411:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c584049e-bfe6-4eea-8738-57e610314e70 00000001:00100000:1.0:1788837520.839426:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8299b52c-6950-430e-a077-88f6eaaeff37 00000001:00100000:3.0:1788837521.328784:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c584049e-bfe6-4eea-8738-57e610314e70 00010000:00010000:2.0:1788837521.701569:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837522.279239:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708742144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837522.279344:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837522.279649:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708742144 00000100:00100000:2.0:1788837522.279657:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708742144 00000100:00100000:2.0:1788837522.279724:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837522.279733:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708742144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837522.279764:0:15160:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837522.279813:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708742144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837522.279821:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837522.279878:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708742144:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788837522.279948:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788837522.356831:0:16440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788837522.725633:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837523.750760:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837523.772826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837523.772866:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837523.772897:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837523.772905:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688830720 00000100:00100000:3.0:1788837523.772915:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688830720 00000100:00100000:1.0:1788837523.772920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837523.772945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837523.772969:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:1.0:1788837523.772972:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837523.772983:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+13:2360:x1875731688830720:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837523.773002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837523.773034:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688830976 00000100:00100000:1.0:1788837523.773039:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688830976 00000100:00100000:3.0:1788837523.773053:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+13:2360:x1875731688830720:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 73us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837523.773062:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:1.0:1788837523.773077:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688831488 00000100:00100000:1.0:1788837523.773081:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688831488 00000100:00100000:1.0:1788837523.773103:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688831104 00000100:00100000:3.0:1788837523.773105:0:15157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688831360 00000100:00100000:3.0:1788837523.773110:0:15157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688831360 00000100:00100000:1.0:1788837523.773118:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688831104 00000100:00100000:3.0:1788837523.773138:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1788837523.773160:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8299b52c-6950-430e-a077-88f6eaaeff37+5:2360:x1875731688830976:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837523.773188:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8299b52c-6950-430e-a077-88f6eaaeff37+5:2360:x1875731688830976:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837523.778743:0:16099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1788837523.778764:0:16099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c584049e-bfe6-4eea-8738-57e610314e70+5:2360:x1875731688831488:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837523.778797:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1788837523.778836:0:16099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c584049e-bfe6-4eea-8738-57e610314e70+5:2360:x1875731688831488:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 82us (5917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837523.778843:0:16099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1788837523.778895:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1788837523.778907:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c584049e-bfe6-4eea-8738-57e610314e70+5:2360:x1875731688831360:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837523.778940:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c584049e-bfe6-4eea-8738-57e610314e70+5:2360:x1875731688831360:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 37us (5939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837523.778947:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1788837523.778964:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1788837523.778979:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8299b52c-6950-430e-a077-88f6eaaeff37+5:2360:x1875731688831104:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837523.779018:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8299b52c-6950-430e-a077-88f6eaaeff37+5:2360:x1875731688831104:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 41us (6050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837523.779025:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1788837523.780822:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688831232 00000100:00100000:0.0:1788837523.780832:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688831232 00000100:00100000:0.0:1788837523.780884:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688830848 00000100:00100000:0.0:1788837523.780887:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688830848 00000100:00100000:0.0:1788837523.780913:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1788837523.780921:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c584049e-bfe6-4eea-8738-57e610314e70+6:2360:x1875731688831232:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837523.780985:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c584049e-bfe6-4eea-8738-57e610314e70+6:2360:x1875731688831232:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 65us (8087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837523.780992:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1788837523.781009:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:0.0:1788837523.781014:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+6:2360:x1875731688830848:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1788837523.781048:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+6:2360:x1875731688830848:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 34us (8104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837523.781055:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00080000:1.0:1788837523.781151:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837523.781156:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837523.781159:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837524.773522:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837525.798637:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837525.863799:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837525.863823:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708742272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837525.863894:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837525.863956:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708742272 00000100:00100000:3.0:1788837525.863965:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708742272 00000100:00100000:3.0:1788837525.864010:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837525.864019:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708742272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837525.864050:0:15160:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788837525.864094:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708742272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837525.864101:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837525.864156:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708742272:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788837525.864350:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837525.864783:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708742656:0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.864823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837525.864847:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837525.864853:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708742528:0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.864879:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837525.864904:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708742656 00000100:00100000:0.0:1788837525.864909:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708742656 00000100:00100000:0.0:1788837525.864941:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837525.864949:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708742656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.864991:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875731708742656:12345-0@lo:400:kworker.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837525.864997:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837525.865017:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708742528 00000100:00100000:0.0:1788837525.865020:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708742528 00000100:00100000:0.0:1788837525.865046:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837525.865052:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708742528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.865082:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708742528:12345-0@lo:400:kworker.0 Request processed in 30us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837525.865088:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837525.865104:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708742784:0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.865127:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837525.865281:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788837525.865300:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3315:1875731708742400:0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.865355:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837525.865380:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708742912:0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.865401:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837525.865434:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708742528:0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.865444:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875731708742656:0@lo:400:kworker.0 00000100:00080000:1.0:1788837525.865608:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837525.865656:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708742400 00000100:00100000:2.0:1788837525.865661:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708742400 00000100:00100000:2.0:1788837525.865697:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837525.865703:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3315:x1875731708742400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837525.865742:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3315:x1875731708742400:12345-0@lo:400:kworker.0 Request processed in 38us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837525.865748:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788837525.865980:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708742784 00000100:00100000:3.0:1788837525.865984:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708742784 00000100:00100000:3.0:1788837525.866025:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708742912 00000100:00100000:3.0:1788837525.866029:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708742912 00000100:00100000:3.0:1788837525.866044:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837525.866049:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708742784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837525.866084:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875731708742784:12345-0@lo:400:kworker.0 Request processed in 34us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837525.866090:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837525.866104:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837525.866119:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708742912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837525.866158:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875731708742912:12345-0@lo:400:kworker.0 Request processed in 39us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837525.866164:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837525.866589:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3315:1875731708742400:0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.866604:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1875731708742912:0@lo:400:kworker.0 00000100:00100000:0.0:1788837525.866613:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1875731708742784:0@lo:400:kworker.0 00000100:00080000:2.0:1788837525.866719:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788837526.808203:0:16590:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed4b95e30 20000000:00000080:2.0:1788837526.808230:0:16590:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9acb74c25800 uarg=0000000000000000 20000000:01000000:2.0:1788837526.808266:0:16590:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788837526.808272:0:16590:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788837526.808276:0:16590:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788837526.813349:0:16591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788837526.813543:0:16590:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 00010000:00010000:1.0:1788837526.822285:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788837526.825170:0:16590:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788837526.825381:0:16590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825402:0:16590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3064b9 expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825410:0:16590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be306506 expref: 18 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825417:0:16590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be30663a expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825427:0:16590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe60 expref: 12 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825434:0:16590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbec2 expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825452:0:16590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825500:0:16590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbec2 expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825523:0:16590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbec2 expref: 12 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837526.825536:0:16590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743040:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837526.825643:0:16590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe60 expref: 12 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825654:0:16590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe60 expref: 12 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837526.825663:0:16590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743168:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837526.825691:0:16590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be30663a expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.825701:0:16590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be30663a expref: 18 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837526.825711:0:16590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743296:0@lo:104: 00000100:00100000:0.0:1788837526.825742:0:16590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837526.825771:0:16590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be306506 expref: 18 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837526.825789:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708743296 00010000:00010000:0.0:1788837526.825790:0:16590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be306506 expref: 18 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837526.825799:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708743296 00000100:00100000:0.0:1788837526.825803:0:16590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e59880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743424:0@lo:104: 00000100:00100000:0.0:1788837526.825831:0:16590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837526.826375:0:16590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x843cbef8be3064b9 expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.826385:0:16590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x843cbef8be3064b9 expref: 18 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837526.826393:0:16590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7904a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743552:0@lo:104: 00000100:00100000:0.0:1788837526.826420:0:16590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837526.839743:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708743424 00000100:00100000:3.0:1788837526.839759:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708743424 00000100:00100000:3.0:1788837526.839819:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837526.839830:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+4:16590:x1875731708743296:12345-0@lo:104: 00010000:00010000:3.0:1788837526.839848:0:14455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.839946:0:14455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837526.839953:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+4:16590:x1875731708743296:12345-0@lo:104: Request processed in 125us (14210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837526.839960:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837526.839979:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788837526.839987:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:16590:x1875731708743424:12345-0@lo:104: 00010000:00010000:3.0:1788837526.839994:0:14455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.840034:0:14455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837526.840039:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:16590:x1875731708743424:12345-0@lo:104: Request processed in 54us (14208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837526.840045:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788837526.840140:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837526.840159:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840169:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543c00 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:1.0:1788837526.840173:0:15695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840183:0:15695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837526.840191:0:15695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837526.840225:0:15695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837526.840269:0:15695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840275:0:15695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837526.840297:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840325:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7f543c00/0x843cbef8be30663a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be306641 expref: -99 pid: 15874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840340:0:15695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837526.840343:0:15695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840349:0:15695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7917a000 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:1.0:1788837526.840353:0:15695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840361:0:15695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837526.840368:0:15695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837526.840373:0:15695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837526.840388:0:15695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840393:0:15695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837526.840405:0:15695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840411:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb7917a000/0x843cbef8be306506 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be30650d expref: -99 pid: 15154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840420:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837526.840422:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837526.840424:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837526.840451:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3313:1875731708743680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837526.840496:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837526.840544:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837526.840549:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3313:1875731708743808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837526.840569:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837526.840605:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708743680 00000100:00100000:1.0:1788837526.840610:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708743680 00000100:00100000:3.0:1788837526.840620:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708743808 00000100:00100000:3.0:1788837526.840627:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708743808 00010000:00010000:1.0:1788837526.840633:0:14457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30663a expref: 19 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.840656:0:14459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be306506 expref: 20 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837526.840663:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837526.840675:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+20:3313:x1875731708743680:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837526.840683:0:14459:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788837526.840686:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788837526.840693:0:14459:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788837526.840694:0:14457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be30663a expref: 20 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840707:0:14457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be30663a expref: 20 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840726:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837526.840764:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+20:3313:x1875731708743680:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837526.840776:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837526.840793:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837526.840799:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3313:x1875731708743808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837526.840807:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837526.840812:0:14457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be306506 expref: 19 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840819:0:14457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be306506 expref: 19 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.840828:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837526.840850:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3313:x1875731708743808:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837526.840856:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788837526.841477:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837526.841508:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3313:1875731708743808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837526.841521:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3313:1875731708743680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837526.844439:0:14455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788837526.844465:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708743552 00000100:00100000:3.0:1788837526.844474:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708743552 00000100:00100000:0.0:1788837526.844481:0:16590:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788837526.844520:0:16590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f576000/0x843cbef8be306641 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be30663a expref: 18 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837526.844536:0:16590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743296:0@lo:104: 00010000:00010000:0.0:1788837526.844549:0:16590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb75236e00/0x843cbef8be30650d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be306506 expref: 17 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837526.844559:0:16590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e59880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743424:0@lo:104: 00000100:00100000:1.0:1788837526.844644:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837526.844656:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:16590:x1875731708743552:12345-0@lo:104: 00010000:00010000:1.0:1788837526.844672:0:14456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.844757:0:14456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837526.844763:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+3:16590:x1875731708743552:12345-0@lo:104: Request processed in 110us (18343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837526.844769:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788837526.848294:0:14461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837526.848324:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837526.848338:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236800 already unused, calling callback (ffffffffc1b87c20) 10000000:00010000:2.0:1788837526.848342:0:14461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837526.848353:0:14461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837526.848389:0:14461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837526.848396:0:14461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788837526.848495:0:14461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.848505:0:14461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837526.848549:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.848558:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3064b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x843cbef8be3064c0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.848578:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837526.848581:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837526.848583:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837526.848591:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3315:1875731708743936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837526.848663:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837526.848705:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708743936 00000100:00100000:1.0:1788837526.848714:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708743936 00010000:00010000:1.0:1788837526.848745:0:14457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3064b9 expref: 17 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837526.848792:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837526.848800:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:3315:x1875731708743936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837526.848814:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837526.848820:0:14457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x843cbef8be3064b9 expref: 17 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.848831:0:14457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x843cbef8be3064b9 expref: 17 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837526.848848:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837526.848869:0:16590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f577400/0x843cbef8be3064c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x843cbef8be3064b9 expref: 17 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837526.848882:0:16590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7904a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743552:0@lo:104: 00000100:00100000:1.0:1788837526.848896:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:3315:x1875731708743936:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837526.848903:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837526.848943:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3315:1875731708743936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837526.853627:0:16590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743040:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837526.853643:0:16590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16590:1875731708743168:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837526.853702:0:16590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837526.854959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837526.855161:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688831616 00000100:00100000:0.0:1788837526.855181:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688831616 00010000:00010000:0.0:1788837526.855225:0:14459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbec2 expref: 13 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837526.855267:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1788837526.855277:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bdc0019-41b5-48db-a629-7682141160f9+13:2361:x1875731688831616:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837526.855291:0:14459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837526.855297:0:14459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbec2 expref: 13 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.855349:0:14459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbec2 expref: 13 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.855367:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb7f543400/0x843cbef8be30679f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbec2 expref: 13 pid: 14466 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837526.855383:0:14459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837526.855435:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bdc0019-41b5-48db-a629-7682141160f9+12:2361:x1875731688831616:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 159us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837526.855442:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1788837526.861176:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837526.861270:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688831744 00000100:00100000:3.0:1788837526.861279:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688831744 00010000:00010000:3.0:1788837526.861390:0:14457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe60 expref: 12 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837526.861428:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1788837526.861453:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bdc0019-41b5-48db-a629-7682141160f9+12:2361:x1875731688831744:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837526.861469:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837526.861475:0:14457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe60 expref: 12 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861494:0:14457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe60 expref: 12 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861513:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb75237800/0x843cbef8be306767 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe60 expref: 12 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861529:0:14457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861537:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861554:0:14457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861561:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861568:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861574:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861580:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075ce00 already unused, calling callback (ffffffffc1558420) 00010000:00010000:3.0:1788837526.861584:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.861599:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837526.861882:0:16590:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837526.861892:0:16590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.863234:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.863252:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9acb5075ce00/0x843cbef8be3067c9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837526.863270:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837526.863365:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bdc0019-41b5-48db-a629-7682141160f9+11:2361:x1875731688831744:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 1909us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837526.863375:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1788837527.397732:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837527.397755:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708744064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837527.397827:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837527.398009:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708744064 00000100:00100000:2.0:1788837527.398017:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708744064 00000100:00100000:2.0:1788837527.398094:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837527.398105:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708744064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837527.398137:0:15160:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788837527.398333:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837527.398416:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708744064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837527.398626:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708744064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837527.398638:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788837527.845766:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788837527.909695:0:14470:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837527.909703:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb741d6800 from 10 10000000:01000000:1.0:1788837527.909709:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837527.909753:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576a00/0x843cbef8be3067d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.909765:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f576a00/0x843cbef8be3067d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.909794:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f576a00/0x843cbef8be3067d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837527.909818:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.909883:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837527.909932:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837527.909998:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708744192 00000100:00100000:3.0:1788837527.910005:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708744192 00000100:00100000:3.0:1788837527.910061:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788837527.910071:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+16:14470:x1875731708744192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837527.910084:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837527.910098:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb75237800/0x843cbef8be3067d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3067d0 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837527.910130:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb75237800/0x843cbef8be3067d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3067d0 expref: 17 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837527.910142:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb75237800/0x843cbef8be3067d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3067d0 expref: 17 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837527.910151:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237800, rc 0) 00000100:00100000:3.0:1788837527.910217:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:14470:x1875731708744192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837527.910223:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788837527.915958:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837527.915986:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f576a00/0x843cbef8be3067d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3067d7 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.915999:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f576a00/0x843cbef8be3067d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3067d7 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837527.916076:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.916151:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837527.916192:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837527.917606:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708744320 00000100:00100000:3.0:1788837527.917618:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708744320 00000100:00100000:3.0:1788837527.917666:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788837527.917677:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:14470:x1875731708744320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837527.917961:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:14470:x1875731708744320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837527.917969:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788837527.918100:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.918152:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.918196:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837527.918238:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837527.920032:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708744448 00000100:00100000:3.0:1788837527.920044:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708744448 00000100:00100000:3.0:1788837527.921382:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788837527.921404:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:14470:x1875731708744448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837527.921645:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:14470:x1875731708744448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (3447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837527.921653:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788837527.921725:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788837527.923712:0:16616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788837527.923786:0:14470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788837527.923808:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837527.923819:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f576a00/0x843cbef8be3067d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3067d7 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837527.923830:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f576a00/0x843cbef8be3067d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3067d7 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837527.923855:0:14470:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837527.923857:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb45de4800 from 10 10000000:01000000:3.0:1788837527.923860:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837527.923892:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3067de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837527.923899:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3067de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837527.923908:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3067de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837527.923930:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79631500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837527.923985:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837527.924017:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79636840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837527.924171:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708744576 00000100:00100000:1.0:1788837527.924179:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708744576 00000100:00100000:1.0:1788837527.924232:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788837527.924241:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+17:14470:x1875731708744576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837527.924383:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837527.924402:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f576e00/0x843cbef8be3067e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3067de expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.924424:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f576e00/0x843cbef8be3067e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3067de expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.924435:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f576e00/0x843cbef8be3067e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3067de expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.924443:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576e00, rc 0) 00000100:00100000:1.0:1788837527.924484:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:14470:x1875731708744576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837527.924491:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788837527.924535:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79631500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837527.924547:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3067de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3067e5 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.924556:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3067de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3067e5 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837527.924600:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.924625:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837527.924638:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837527.924649:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708744704 00000100:00100000:1.0:1788837527.924652:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708744704 00000100:00100000:1.0:1788837527.924669:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788837527.924675:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:14470:x1875731708744704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.924882:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:14470:x1875731708744704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837527.924894:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788837527.924920:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.924942:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.924973:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837527.924985:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837527.924996:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708744832 00000100:00100000:1.0:1788837527.924999:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708744832 00000100:00100000:1.0:1788837527.925015:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788837527.925020:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:14470:x1875731708744832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.928641:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:14470:x1875731708744832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3608us (3655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837527.928657:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788837527.928743:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788837527.931632:0:16617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788837527.931714:0:14470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788837527.931731:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837527.931741:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3067de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3067e5 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.931751:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb75236800/0x843cbef8be3067de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3067e5 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837527.931761:0:14470:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837527.931764:0:14470:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9acb47ed0000 from 10 10000000:01000000:1.0:1788837527.931766:0:14470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837527.931800:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f577800/0x843cbef8be3067ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.931816:0:14470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9acb7f577800/0x843cbef8be3067ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.931827:0:14470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9acb7f577800/0x843cbef8be3067ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837527.931848:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.931907:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837527.931931:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5834bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837527.931950:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708744960 00000100:00100000:1.0:1788837527.931955:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708744960 00000100:00100000:1.0:1788837527.931992:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837527.932000:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+18:14470:x1875731708744960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837527.932012:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837527.932024:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f577200/0x843cbef8be3067f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x843cbef8be3067ec expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.932047:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f577200/0x843cbef8be3067f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x843cbef8be3067ec expref: 19 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.932058:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f577200/0x843cbef8be3067f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x843cbef8be3067ec expref: 19 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.932066:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f577200, rc 0) 00000100:00100000:1.0:1788837527.937442:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:14470:x1875731708744960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5431us (5523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837527.937455:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788837527.937594:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708744960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837527.937618:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9acb7f577800/0x843cbef8be3067ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3067f3 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837527.937631:0:14470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9acb7f577800/0x843cbef8be3067ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x843cbef8be3067f3 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837527.937699:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708745088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837527.937742:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837527.937779:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79636480 going to sleep for 11 seconds 00000100:00100000:1.0:1788837527.942258:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708745088 00000100:00100000:1.0:1788837527.942274:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708745088 00000100:00100000:1.0:1788837527.942344:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788837527.942358:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:14470:x1875731708745088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.942641:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:14470:x1875731708745088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (4897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837527.942774:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708745088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837527.942823:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79630a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708745216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837527.942880:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837527.942907:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79636480 going to sleep for 11 seconds 00000100:00100000:3.0:1788837527.951230:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708745216 00000100:00100000:3.0:1788837527.951244:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708745216 00000100:00100000:3.0:1788837527.951296:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788837527.951319:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+20:14470:x1875731708745216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837527.951547:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fbef8f-8952-49e4-a88d-774a3e8128a4+20:14470:x1875731708745216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (8666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837527.951555:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788837527.951758:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79630a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fbef8f-8952-49e4-a88d-774a3e8128a4:14470:1875731708745216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837527.955793:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000040:00080000:3.0:1788837527.957941:0:16618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788837527.958065:0:14470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788837527.958084:0:14470:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837527.958095:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9acb7f577800/0x843cbef8be3067ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3067f3 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837527.960318:0:14470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9acb7f577800/0x843cbef8be3067ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x843cbef8be3067f3 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837528.506196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837528.506405:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688831872 00000100:00100000:1.0:1788837528.506415:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688831872 00000100:00100000:1.0:1788837528.506472:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:1.0:1788837528.506483:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+11:13795:x1875731688831872:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837528.506499:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837528.506516:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f576800/0x843cbef8be3067fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbef3 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837528.506544:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f576800/0x843cbef8be3067fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbef3 expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837528.506556:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f576800/0x843cbef8be3067fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbef3 expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837528.506575:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576800, rc 0) 00000100:00100000:1.0:1788837528.506650:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+12:13795:x1875731688831872:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 169us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837528.506658:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:2.0:1788837528.511770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837528.511887:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688832000 00000100:00100000:3.0:1788837528.511898:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688832000 00000100:00100000:3.0:1788837528.511963:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:3.0:1788837528.511974:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7f6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+12:13795:x1875731688832000:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837528.512291:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7f6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+12:13795:x1875731688832000:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 318us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837528.512300:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:2.0:1788837528.516058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837528.516248:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688832128 00000100:00100000:3.0:1788837528.516258:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688832128 00000100:00100000:3.0:1788837528.516333:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:3.0:1788837528.516343:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+12:13795:x1875731688832128:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837528.516544:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4bdc0019-41b5-48db-a629-7682141160f9+12:13795:x1875731688832128:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 202us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837528.516553:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:0.0:1788837528.541292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837528.541463:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688832256 00000100:00100000:2.0:1788837528.541478:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688832256 00000100:00100000:2.0:1788837528.541625:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:2.0:1788837528.541637:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+12:13795:x1875731688832256:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837528.541654:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837528.541672:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9acb7f543600/0x843cbef8be306801 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbefa expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837528.541701:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9acb7f543600/0x843cbef8be306801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbefa expref: 13 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837528.541713:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9acb7f543600/0x843cbef8be306801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbefa expref: 13 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837528.541722:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543600, rc 0) 00000100:00100000:2.0:1788837528.541784:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+13:13795:x1875731688832256:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 150us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837528.541793:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:3.0:1788837528.548418:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837528.549230:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688832384 00000100:00100000:2.0:1788837528.549241:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688832384 00000100:00100000:2.0:1788837528.549288:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:2.0:1788837528.549299:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+13:13795:x1875731688832384:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837528.556791:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4bdc0019-41b5-48db-a629-7682141160f9+13:13795:x1875731688832384:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 7488us (8376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837528.556803:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:1.0:1788837528.566277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837528.566394:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688832512 00000100:00100000:2.0:1788837528.566405:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688832512 00000100:00100000:2.0:1788837528.566458:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:2.0:1788837528.566467:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+13:13795:x1875731688832512:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837528.566802:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+13:13795:x1875731688832512:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 334us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837528.566811:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00010000:00010000:2.0:1788837528.870138:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837528.897441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837528.897487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837528.897494:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688832640 00000100:00100000:1.0:1788837528.897506:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688832640 00000100:00100000:3.0:1788837528.897518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837528.897545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837528.897569:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837528.897594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837528.897611:0:15157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688832896 00000100:00100000:2.0:1788837528.897618:0:15157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688832896 00000100:00100000:3.0:1788837528.897621:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688833152 00000100:00100000:3.0:1788837528.897628:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688833152 00000100:00100000:2.0:1788837528.897646:0:15157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688832768 00000100:00100000:2.0:1788837528.897651:0:15157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688832768 00000100:00100000:3.0:1788837528.897658:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688833280 00000100:00100000:3.0:1788837528.897663:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688833280 00000100:00100000:2.0:1788837528.897694:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:2.0:1788837528.897711:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8299b52c-6950-430e-a077-88f6eaaeff37+5:2359:x1875731688832896:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837528.897780:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8299b52c-6950-430e-a077-88f6eaaeff37+5:2359:x1875731688832896:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 72us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837528.900154:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688833024 00000100:00100000:1.0:1788837528.900167:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688833024 00000100:00100000:1.0:1788837528.900251:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1788837528.900262:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+6:2359:x1875731688832640:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837528.900347:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+6:2359:x1875731688832640:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 87us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837528.900355:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1788837528.900374:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:1.0:1788837528.900381:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c584049e-bfe6-4eea-8738-57e610314e70+6:2359:x1875731688833024:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837528.900407:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c584049e-bfe6-4eea-8738-57e610314e70+6:2359:x1875731688833024:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (2837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837528.900413:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00080000:1.0:1788837528.900436:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837528.900440:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837528.900444:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837528.907578:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1788837528.907600:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c584049e-bfe6-4eea-8738-57e610314e70+5:2359:x1875731688833152:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837528.907675:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c584049e-bfe6-4eea-8738-57e610314e70+5:2359:x1875731688833152:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 84us (10156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837528.907683:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1788837528.911040:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1788837528.911072:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8299b52c-6950-430e-a077-88f6eaaeff37+5:2359:x1875731688832768:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837528.913126:0:15158:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788837528.913146:0:15158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788837528.913475:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1788837528.913491:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c584049e-bfe6-4eea-8738-57e610314e70+5:2359:x1875731688833280:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837528.913574:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c584049e-bfe6-4eea-8738-57e610314e70+5:2359:x1875731688833280:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 88us (15978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837528.913582:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1788837528.914961:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8299b52c-6950-430e-a077-88f6eaaeff37+5:2359:x1875731688832768:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3903us (17409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837528.914973:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1788837528.916923:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000040:00080000:2.0:1788837529.254025:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788837529.893514:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837530.918044:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837530.981627:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837530.981657:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708745344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837530.981726:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837530.981780:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708745344 00000100:00100000:1.0:1788837530.981790:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708745344 00000100:00100000:1.0:1788837530.981858:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837530.981881:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708745344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837530.981916:0:15159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837530.981972:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708745344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837530.981980:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837530.982034:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708745344:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788837530.982154:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837530.984490:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708745728:0@lo:400:kworker.0 00000100:00100000:3.0:1788837530.984551:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837530.984582:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708745600:0@lo:400:kworker.0 00000100:00100000:3.0:1788837530.984605:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708745728 00000100:00100000:3.0:1788837530.984612:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708745728 00000100:00100000:0.0:1788837530.984627:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837530.984675:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837530.984685:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708745728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837530.984690:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708745600 00000100:00100000:0.0:1788837530.984696:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708745600 00000100:00100000:3.0:1788837530.984740:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875731708745728:12345-0@lo:400:kworker.0 Request processed in 57us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837530.984747:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837530.984758:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837530.984767:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708745600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837530.984809:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875731708745728:0@lo:400:kworker.0 00000100:00100000:3.0:1788837530.984831:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708745472:0@lo:400:kworker.0 00000100:00100000:1.0:1788837530.984920:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708745856:0@lo:400:kworker.0 00000100:00080000:2.0:1788837530.988838:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837530.991134:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708745600:12345-0@lo:400:kworker.0 Request processed in 6358us (6506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837530.991150:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837530.991158:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837530.991231:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb48ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708745984:0@lo:400:kworker.0 00000100:00100000:0.0:1788837530.991256:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708745600:0@lo:400:kworker.0 00000100:00100000:3.0:1788837530.991362:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837530.991477:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708745472 00000100:00100000:3.0:1788837530.991485:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708745472 00000100:00100000:3.0:1788837530.991597:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788837530.991607:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3314:x1875731708745472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837530.991655:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3314:x1875731708745472:12345-0@lo:400:kworker.0 Request processed in 50us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837530.991686:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708745984 00000100:00100000:0.0:1788837530.991691:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708745984 00000100:00100000:3.0:1788837530.991761:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788837530.991791:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788837530.991796:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708745472:0@lo:400:kworker.0 00000100:00100000:0.0:1788837530.991803:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708745984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788837530.991820:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837530.991861:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708745984:12345-0@lo:400:kworker.0 Request processed in 52us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837530.991869:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788837530.991874:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708745984:0@lo:400:kworker.0 00000100:00100000:1.0:1788837530.993911:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837530.994085:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708745856 00000100:00100000:3.0:1788837530.994102:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708745856 00000100:00100000:3.0:1788837530.994161:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837530.994170:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708745856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837530.994232:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875731708745856:12345-0@lo:400:kworker.0 Request processed in 63us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837530.994239:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788837530.994539:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837530.994574:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb48ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1875731708745856:0@lo:400:kworker.0 00000100:00100000:0.0:1788837531.083815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837531.083974:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688833408 00000100:00100000:3.0:1788837531.084001:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688833408 00000100:00100000:3.0:1788837531.084086:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1788837531.084098:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+6:14450:x1875731688833408:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837531.084117:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837531.084137:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf01 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.084210:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.084227:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.084237:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.084251:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.084258:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.084264:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788837531.084526:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837531.085002:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236600/0x843cbef8be30681d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085015:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236600/0x843cbef8be30681d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085023:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236600/0x843cbef8be30681d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837531.085055:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788837531.085058:0:14472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837531.085088:0:14472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236600/0x843cbef8be30681d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085099:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085105:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085112:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085119:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837531.085123:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085130:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085141:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb4556d200) 00010000:00010000:3.0:1788837531.085145:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837531.085149:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085155:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be30680f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085167:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085182:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085199:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085204:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837531.085207:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085213:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085221:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9acb4556d800) 00010000:00010000:3.0:1788837531.085223:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837531.085226:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085231:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306816 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085269:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf01 expref: 8 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085283:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236600/0x843cbef8be30681d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf01 expref: 7 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.085291:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9acb4556da00) 00010000:00010000:3.0:1788837531.085293:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837531.085403:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236600, rc 0) 00000100:00100000:2.0:1788837531.088596:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+7:14450:x1875731688833408:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 4490us (4780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837531.088609:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1788837531.096163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837531.096347:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688833664 00000100:00100000:0.0:1788837531.096357:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688833664 00000100:00100000:0.0:1788837531.096422:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1788837531.096443:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+7:14450:x1875731688833664:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837531.096481:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837531.096502:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be306824 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf08 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.096588:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.096603:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.096615:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.096681:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.096689:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.096697:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.097009:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d600/0x843cbef8be306839 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.097019:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d600/0x843cbef8be306839 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.097026:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d600/0x843cbef8be306839 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837531.097036:0:14474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788837531.103842:0:14474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103860:0:14474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103868:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103875:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837531.103879:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103886:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103904:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9acb4556da00) 00010000:00010000:2.0:1788837531.103920:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.103924:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103930:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be30682b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103944:0:14474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103950:0:14474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103956:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103977:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837531.103980:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103987:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.103994:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9acb50df5000) 00010000:00010000:2.0:1788837531.103996:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.103998:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.104004:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306832 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.106056:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be306824 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf08 expref: 10 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.106080:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d600/0x843cbef8be306839 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf08 expref: 9 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.106090:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:2.0:1788837531.106105:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.106109:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075d600, rc 0) 00000100:00100000:2.0:1788837531.106178:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+9:14450:x1875731688833664:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 9736us (10026us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788837531.106196:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1788837531.120623:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837531.120740:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688833792 00000100:00100000:0.0:1788837531.120755:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688833792 00000100:00100000:0.0:1788837531.120842:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1788837531.120853:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+9:14450:x1875731688833792:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788837531.120972:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+9:14450:x1875731688833792:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 121us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837531.120980:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1788837531.164690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.164804:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688833920 00000100:00100000:2.0:1788837531.164836:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688833920 00000100:00100000:2.0:1788837531.164914:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1788837531.164927:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+9:14456:x1875731688833920:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837531.164953:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837531.164981:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306847 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf0f expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165079:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165349:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165371:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165392:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165401:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165408:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165948:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165961:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165969:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165983:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837531.165989:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.165998:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166015:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb4556d200) 00010000:00010000:2.0:1788837531.166019:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.166024:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166032:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be30684e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166046:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166053:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166072:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166077:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837531.166080:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166086:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166106:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9acb454ce600) 00010000:00010000:2.0:1788837531.166109:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.166113:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166118:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be306855 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166740:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306847 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf0f expref: 10 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.166759:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb4556d200) 00010000:00010000:2.0:1788837531.166763:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.166769:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306847 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf0f expref: 10 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.167136:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543400, rc 0) 00000100:00100000:3.0:1788837531.167887:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+9:14456:x1875731688833920:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2953us (3205us total) trans 0 rc 301/301 00000100:00100000:3.0:1788837531.167901:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1788837531.174245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837531.174386:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688834048 00000100:00100000:3.0:1788837531.174405:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688834048 00000100:00100000:3.0:1788837531.174485:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1788837531.174498:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8299b52c-6950-430e-a077-88f6eaaeff37+9:14456:x1875731688834048:12345-192.168.203.43@tcp:700:lfs.0 00000100:00100000:3.0:1788837531.174654:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8299b52c-6950-430e-a077-88f6eaaeff37+9:14456:x1875731688834048:12345-192.168.203.43@tcp:700:lfs.0 Request processed in 158us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837531.174662:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1788837531.177479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837531.181223:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688834304 00000100:00100000:0.0:1788837531.181243:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688834304 00000100:00100000:0.0:1788837531.181357:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1788837531.181370:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+9:14456:x1875731688834304:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:0.0:1788837531.181446:0:15691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837531.181485:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be30678a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbe8a expref: 9 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.181508:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb4556d200) 00010000:00010000:0.0:1788837531.181513:0:15691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837531.181808:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.181825:0:15691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbeec expref: 5 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.181835:0:15691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.181879:0:15691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbeec expref: 5 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.181916:0:15691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbeec expref: 5 pid: 14472 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837531.181934:0:15691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7904b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15691:1875731708746112:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837531.182078:0:15691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837531.186504:0:15691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7904b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15691:1875731708746112:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837531.186545:0:15691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837531.191953:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837531.192072:0:16592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688834432 00000100:00100000:1.0:1788837531.192086:0:16592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688834432 00010000:00010000:1.0:1788837531.192451:0:16592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbeec expref: 6 pid: 14472 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837531.192486:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1788837531.192496:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c584049e-bfe6-4eea-8738-57e610314e70+6:2361:x1875731688834432:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837531.192510:0:16592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837531.192517:0:16592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbeec expref: 6 pid: 14472 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.192536:0:16592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbeec expref: 6 pid: 14472 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.192558:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be3067c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbeec expref: 6 pid: 14472 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.192589:0:16592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb4556d200) 00010000:00010000:1.0:1788837531.192595:0:16592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.192605:0:16592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788837531.192612:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837531.192615:0:16592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.192647:0:16592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837531.192717:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c584049e-bfe6-4eea-8738-57e610314e70+5:2361:x1875731688834432:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 222us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837531.192724:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00010000:00010000:2.0:1788837531.193048:0:15691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.193070:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.193113:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.193129:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.193140:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837531.199992:0:15691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788837531.200019:0:15691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.200030:0:15691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.200039:0:15691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.200045:0:15691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075d000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837531.200051:0:15691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.200067:0:15691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.200090:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb4556d200) 00010000:00010000:3.0:1788837531.200093:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837531.200098:0:15691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.200104:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075d000/0x843cbef8be30685c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837531.200133:0:15691:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5925784 reply state 00000000dadaa251 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837531.200143:0:15691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837531.200341:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+10:14456:x1875731688834304:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 18930us (22833us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788837531.200353:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00010000:00010000:0.0:1788837531.203953:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.203981:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.203990:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.203998:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837531.204004:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.204013:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.204036:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9acb454ce600) 00010000:00010000:0.0:1788837531.204039:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837531.204076:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.204083:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be306863 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837531.302537:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788837531.310011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.310945:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688834560 00000100:00100000:2.0:1788837531.310961:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688834560 00000100:00100000:2.0:1788837531.311048:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1788837531.311061:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+9:14464:x1875731688834560:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:2.0:1788837531.311225:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837531.311261:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30686a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf16 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.311398:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306871 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.311415:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.311430:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837531.311477:0:14474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837531.311481:0:14474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837531.311529:0:14474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.311558:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be30686a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf16 expref: 11 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.311582:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542600/0x843cbef8be306871 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf16 expref: 10 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.311614:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:2.0:1788837531.311618:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837531.311622:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542600, rc 0) 00000100:00100000:2.0:1788837531.311720:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+10:14464:x1875731688834560:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 661us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837531.311728:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1788837531.336990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.337114:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688834688 00000100:00100000:2.0:1788837531.337126:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688834688 00000100:00100000:2.0:1788837531.337411:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1788837531.337425:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+5:14465:x1875731688834688:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837531.337451:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837531.337478:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be306878 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf1d expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.337565:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be30687f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.337582:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be30687f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.337597:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be30687f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837531.337644:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837531.337648:0:14472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837531.337675:0:14472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be30687f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.337730:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be306878 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf1d expref: 7 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.337751:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543400/0x843cbef8be30687f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf1d expref: 6 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.337760:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:2.0:1788837531.337764:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837531.337767:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f543400, rc 0) 00000100:00100000:2.0:1788837531.337856:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+6:14465:x1875731688834688:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 434us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837531.337864:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:3.0:1788837531.346240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837531.346394:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688834816 00000100:00100000:0.0:1788837531.346408:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688834816 00000100:00100000:0.0:1788837531.346547:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:0.0:1788837531.346560:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c584049e-bfe6-4eea-8738-57e610314e70+6:14465:x1875731688834816:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1788837531.346587:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837531.346616:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306886 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf24 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.346705:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.346724:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.346738:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.346756:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.346764:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.346771:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349590:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be30689b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349613:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be30689b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349634:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be30689b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837531.349679:0:14473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788837531.349683:0:14473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837531.349706:0:14473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be30689b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349719:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349727:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349734:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349740:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075ca00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837531.349744:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349751:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349763:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:0.0:1788837531.349780:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837531.349786:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349792:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be30688d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349810:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349816:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349823:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349827:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075da00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837531.349830:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349835:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349842:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9acb50df5800) 00010000:00010000:0.0:1788837531.349844:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837531.349846:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349851:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306894 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349971:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306886 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf24 expref: 8 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.349999:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be30689b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf24 expref: 7 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.350007:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:0.0:1788837531.350009:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837531.350011:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075ce00, rc 0) 00000100:00100000:0.0:1788837531.350085:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c584049e-bfe6-4eea-8738-57e610314e70+7:14465:x1875731688834816:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 3527us (4033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837531.350093:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1788837531.356884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.357059:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688835072 00000100:00100000:2.0:1788837531.357085:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688835072 00000100:00100000:2.0:1788837531.357172:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1788837531.357193:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+7:14465:x1875731688835072:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837531.357222:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837531.357251:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be3068a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf2b expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837531.357422:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788837531.357575:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be3068a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf2b expref: 9 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.357593:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:2.0:1788837531.357597:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837531.357632:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be3068a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf2b expref: 9 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.357651:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542800, rc 0) 00000100:00100000:2.0:1788837531.357733:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+8:14465:x1875731688835072:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 550us (865us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788837531.357741:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1788837531.360941:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.361604:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688835328 00000100:00100000:2.0:1788837531.361632:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688835328 00000100:00100000:3.0:1788837531.361866:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1788837531.361883:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c584049e-bfe6-4eea-8738-57e610314e70+8:14465:x1875731688835328:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:3.0:1788837531.361971:0:14474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837531.362012:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be30689b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf24 expref: 8 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.362064:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb50df5900) 00010000:00010000:3.0:1788837531.362080:0:14474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837531.362127:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.362150:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.362163:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837531.362497:0:14474:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067be53e7 reply state 000000008124146e transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837531.362508:0:14474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788837531.362519:0:14474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788837531.362930:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c584049e-bfe6-4eea-8738-57e610314e70+9:14465:x1875731688835328:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 1049us (2003us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788837531.362942:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1788837531.370158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.370377:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688835584 00000100:00100000:2.0:1788837531.370390:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688835584 00000100:00100000:2.0:1788837531.370459:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1788837531.370472:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c584049e-bfe6-4eea-8738-57e610314e70+9:14465:x1875731688835584:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1788837531.370791:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c584049e-bfe6-4eea-8738-57e610314e70+10:14465:x1875731688835584:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 320us (659us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788837531.370800:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00010000:00010000:1.0:1788837531.372015:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.372035:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.372044:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.372052:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837531.372057:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.372079:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.372130:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb4556d200) 00010000:00010000:1.0:1788837531.372133:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788837531.372151:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.372159:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be3068b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837531.373444:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.373599:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688835840 00000100:00100000:2.0:1788837531.373612:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688835840 00000100:00100000:2.0:1788837531.373697:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1788837531.373710:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+9:14465:x1875731688835840:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837531.373742:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837531.373769:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be3068b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf32 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.373876:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.373895:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.373924:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.373941:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.373949:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.373955:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837531.374112:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788837531.374252:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374261:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374268:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374276:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837531.374281:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374288:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374358:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:2.0:1788837531.374362:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.374375:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374383:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374400:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374406:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374412:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374418:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837531.374421:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374427:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374435:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9acb454ce900) 00010000:00010000:2.0:1788837531.374438:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.374441:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374447:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374493:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be3068b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf32 expref: 11 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374516:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:2.0:1788837531.374519:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837531.374523:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be3068b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf32 expref: 11 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.374534:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f542800, rc 0) 00000100:00100000:2.0:1788837531.374621:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c584049e-bfe6-4eea-8738-57e610314e70+10:14465:x1875731688835840:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 913us (1187us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788837531.374631:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:0.0:1788837531.378456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837531.378786:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688835968 00000100:00100000:3.0:1788837531.378800:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688835968 00000100:00100000:3.0:1788837531.378884:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:3.0:1788837531.378898:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c584049e-bfe6-4eea-8738-57e610314e70+10:14465:x1875731688835968:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837531.378932:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837531.378964:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3068d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf39 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.379123:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.379152:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.379165:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837531.379207:0:14473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788837531.379211:0:14473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837531.379236:0:14473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.379266:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3068d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf39 expref: 12 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.379286:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf39 expref: 11 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.379296:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb4556d800) 00010000:00010000:3.0:1788837531.379299:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837531.379571:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237a00, rc 0) 00000100:00100000:3.0:1788837531.379664:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c584049e-bfe6-4eea-8738-57e610314e70+11:14465:x1875731688835968:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 768us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837531.379672:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:0.0:1788837531.383770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.383897:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688836096 00000100:00100000:2.0:1788837531.383912:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688836096 00000100:00100000:2.0:1788837531.383988:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1788837531.384002:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c584049e-bfe6-4eea-8738-57e610314e70+11:14465:x1875731688836096:12345-192.168.203.43@tcp:37:lfs.0 00000100:00100000:2.0:1788837531.390467:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c584049e-bfe6-4eea-8738-57e610314e70+11:14465:x1875731688836096:12345-192.168.203.43@tcp:37:lfs.0 Request processed in 6449us (6696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837531.390485:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:0.0:1788837531.405442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837531.405648:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688836352 00000100:00100000:3.0:1788837531.405661:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688836352 00000100:00100000:3.0:1788837531.405763:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1788837531.405776:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45d35850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c584049e-bfe6-4eea-8738-57e610314e70+11:14465:x1875731688836352:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1788837531.406382:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45d35850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c584049e-bfe6-4eea-8738-57e610314e70+12:14465:x1875731688836352:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 606us (952us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788837531.406393:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1788837531.483079:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.487542:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688836480 00000100:00100000:2.0:1788837531.487565:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688836480 00000100:00100000:2.0:1788837531.487685:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:2.0:1788837531.487699:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+10:14471:x1875731688836480:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1788837531.487728:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837531.487757:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be3068e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf40 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.487846:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.487887:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.487900:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.487916:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.487923:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.487930:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488052:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3068f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488076:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3068f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488083:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3068f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837531.488122:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788837531.488126:0:14472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837531.488370:0:14472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3068f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488387:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488402:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488410:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488417:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f542200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837531.488422:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488431:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488446:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:2.0:1788837531.488449:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.488455:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488461:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542200/0x843cbef8be3068e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488477:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488482:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488487:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488492:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f543c00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837531.488500:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488506:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488514:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9acb454ce900) 00010000:00010000:2.0:1788837531.488516:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837531.488519:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488525:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f543c00/0x843cbef8be3068ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488565:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f542800/0x843cbef8be3068e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf40 expref: 12 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488581:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2600/0x843cbef8be3068f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf40 expref: 11 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.488588:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb4556d800) 00010000:00010000:2.0:1788837531.488591:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788837531.488594:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2600, rc 0) 00000100:00100000:2.0:1788837531.488742:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+11:14471:x1875731688836480:12345-192.168.203.43@tcp:101:bash.0 Request processed in 1044us (5689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837531.488751:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:0.0:1788837531.492096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837531.492345:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688836736 00000100:00100000:3.0:1788837531.492360:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688836736 00000100:00100000:3.0:1788837531.492442:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:3.0:1788837531.492454:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+11:14471:x1875731688836736:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1788837531.492480:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837531.492506:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3068fd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf47 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.492840:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.492859:0:14474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf39 expref: 11 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.492868:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.492915:0:14474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf39 expref: 11 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.492943:0:14474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf39 expref: 11 pid: 14473 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837531.492984:0:14474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75811f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14474:1875731708746240:192.168.203.43@tcp:104: 00000100:00100000:3.0:1788837531.493168:0:14474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb79636c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837531.503203:0:14474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75811f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14474:1875731708746240:192.168.203.43@tcp:104: 00010000:00010000:3.0:1788837531.503247:0:14474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837531.504493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837531.504603:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688836864 00000100:00100000:1.0:1788837531.504614:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688836864 00010000:00010000:1.0:1788837531.504748:0:14458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf39 expref: 12 pid: 14473 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837531.504923:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1788837531.504935:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c584049e-bfe6-4eea-8738-57e610314e70+12:2361:x1875731688836864:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837531.504956:0:14458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837531.504964:0:14458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf39 expref: 12 pid: 14473 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.504989:0:14458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf39 expref: 12 pid: 14473 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.505017:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be3068da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf39 expref: 12 pid: 14473 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.505036:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb4556d800) 00010000:00010000:1.0:1788837531.505042:0:14458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.505071:0:14458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.505080:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.505408:0:14458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837531.505489:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c584049e-bfe6-4eea-8738-57e610314e70+11:2361:x1875731688836864:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 554us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837531.505499:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00010000:00010000:0.0:1788837531.510784:0:14474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.510806:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.510850:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.510866:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.510902:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.511975:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.511993:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.512005:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837531.512017:0:14474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788837531.512047:0:14474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.512055:0:14474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.512063:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.512069:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236e00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837531.512074:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.512082:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.512208:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb4556d800) 00010000:00010000:0.0:1788837531.512211:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837531.512229:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.512237:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306904 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837531.512255:0:14474:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b233234b reply state 00000000b58bf0c6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837531.512265:0:14474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788837531.512353:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be3068fd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf47 expref: 14 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.512372:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf47 expref: 13 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.512380:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:0.0:1788837531.512382:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788837531.512385:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075ca00, rc 0) 00000100:00100000:0.0:1788837531.512474:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+14:14471:x1875731688836736:12345-192.168.203.43@tcp:101:bash.0 Request processed in 20021us (20393us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788837531.512484:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00010000:00010000:3.0:1788837531.515802:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.515827:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.515836:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.515844:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075cc00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837531.515850:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.515859:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.515879:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9acb50df5300) 00010000:00010000:3.0:1788837531.515883:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837531.515889:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.515895:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be30690b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837531.534545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.534658:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688836992 00000100:00100000:2.0:1788837531.534672:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688836992 00000100:00100000:2.0:1788837531.534750:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:2.0:1788837531.534761:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+13:14471:x1875731688836992:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1788837531.534809:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837531.534836:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be306920 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf4e expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.534918:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3e00/0x843cbef8be306927 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.534935:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3e00/0x843cbef8be306927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.534948:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3e00/0x843cbef8be306927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837531.534996:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788837531.535001:0:14472:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837531.535022:0:14472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3e00/0x843cbef8be306927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.535034:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3e00/0x843cbef8be306927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.535060:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be306920 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf4e expref: 15 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.535081:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3e00/0x843cbef8be306927 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf4e expref: 14 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.535091:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:2.0:1788837531.535095:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837531.535109:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f3e00, rc 0) 00000100:00100000:2.0:1788837531.535205:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+14:14471:x1875731688836992:12345-192.168.203.43@tcp:101:bash.0 Request processed in 445us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837531.535213:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1788837531.545431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837531.545523:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688837248 00000100:00100000:3.0:1788837531.545538:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688837248 00000100:00100000:3.0:1788837531.545605:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1788837531.545730:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+14:14471:x1875731688837248:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:3.0:1788837531.547116:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+15:14471:x1875731688837248:12345-192.168.203.43@tcp:35:bash.0 Request processed in 1493us (1691us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788837531.547129:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1788837531.695836:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837531.696032:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688837504 00000100:00100000:3.0:1788837531.696046:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688837504 00000100:00100000:3.0:1788837531.696408:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:3.0:1788837531.696423:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+15:14481:x1875731688837504:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837531.696455:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837531.696487:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be30692e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf55 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837531.696609:0:14473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788837531.696775:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be30692e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf55 expref: 17 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.696793:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:3.0:1788837531.696796:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837531.696802:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be30692e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf55 expref: 17 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837531.696821:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237200, rc 0) 00000100:00100000:3.0:1788837531.696907:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+16:14481:x1875731688837504:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 489us (1085us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788837531.696937:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:0.0:1788837531.700484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.700563:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688837760 00000100:00100000:2.0:1788837531.700576:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688837760 00000100:00100000:2.0:1788837531.700639:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1788837531.700650:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8299b52c-6950-430e-a077-88f6eaaeff37+16:14481:x1875731688837760:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1788837531.700977:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8299b52c-6950-430e-a077-88f6eaaeff37+17:14481:x1875731688837760:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 328us (508us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788837531.700986:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1788837531.763602:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837531.763906:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688838016 00000100:00100000:2.0:1788837531.763921:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688838016 00000100:00100000:2.0:1788837531.763999:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:2.0:1788837531.764012:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+17:14484:x1875731688838016:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1788837531.764043:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837531.764071:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be30693c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf5c expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.764513:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2400/0x843cbef8be306943 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.764531:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2400/0x843cbef8be306943 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.764544:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2400/0x843cbef8be306943 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837531.764557:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788837531.765918:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be30693c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf5c expref: 20 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.765959:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2400/0x843cbef8be306943 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf5c expref: 19 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837531.765972:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:2.0:1788837531.765976:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837531.765981:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2400, rc 0) 00000100:00100000:2.0:1788837531.767037:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+19:14484:x1875731688838016:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 3015us (3438us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788837531.767052:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:1.0:1788837531.781280:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837531.781524:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688838144 00000100:00100000:0.0:1788837531.781537:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688838144 00000100:00100000:0.0:1788837531.781612:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:0.0:1788837531.781623:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+19:14484:x1875731688838144:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:0.0:1788837531.781741:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.781763:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.781777:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.781809:0:14474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.781816:0:14474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.781824:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.781830:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075de00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837531.781836:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.781844:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.781857:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:0.0:1788837531.781859:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837531.781864:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837531.781869:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306951 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837531.781970:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+19:14484:x1875731688838144:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 347us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837531.781978:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:0.0:1788837531.787047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837531.790697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837531.790878:0:16592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688838272 00000100:00100000:1.0:1788837531.790892:0:16592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688838272 00000100:00100000:1.0:1788837531.791031:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1788837531.791045:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8299b52c-6950-430e-a077-88f6eaaeff37+19:2358:x1875731688838272:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837531.791066:0:16592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837531.791099:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2400/0x843cbef8be306943 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf5c expref: 19 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837531.791123:0:16592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:1.0:1788837531.791129:0:16592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837531.791212:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8299b52c-6950-430e-a077-88f6eaaeff37+18:2358:x1875731688838272:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 170us (4179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837531.791220:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1788837531.800077:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688838528 00000100:00100000:2.0:1788837531.800102:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688838528 00000100:00100000:2.0:1788837531.801943:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1788837531.801977:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8299b52c-6950-430e-a077-88f6eaaeff37+18:14484:x1875731688838528:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1788837531.802353:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8299b52c-6950-430e-a077-88f6eaaeff37+19:14484:x1875731688838528:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 393us (11669us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788837531.802362:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00010000:00010000:2.0:1788837531.941903:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837532.112086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837532.112215:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688838784 00000100:00100000:2.0:1788837532.112235:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688838784 00000100:00100000:2.0:1788837532.112374:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1788837532.112386:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+19:14515:x1875731688838784:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:2.0:1788837532.112417:0:15691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837532.112445:0:15691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be306958 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf63 expref: -99 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.112734:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2a00/0x843cbef8be30695f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.112755:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2a00/0x843cbef8be30695f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.112769:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2a00/0x843cbef8be30695f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837532.112782:0:15691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788837532.112943:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3400/0x843cbef8be306958 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf63 expref: 22 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.112966:0:15691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2a00/0x843cbef8be30695f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf63 expref: 21 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.112975:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:2.0:1788837532.112978:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837532.112981:0:15691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2a00, rc 0) 00000100:00100000:2.0:1788837532.113234:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+21:14515:x1875731688838784:12345-192.168.203.43@tcp:101:cat.0 Request processed in 848us (1155us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788837532.113243:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1788837532.123632:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837532.123712:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688839040 00000100:00100000:3.0:1788837532.123721:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688839040 00000100:00100000:3.0:1788837532.123772:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1788837532.123781:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+21:14515:x1875731688839040:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:3.0:1788837532.124110:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+22:14515:x1875731688839040:12345-192.168.203.43@tcp:35:cat.0 Request processed in 328us (487us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788837532.124126:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1788837532.128845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837532.128938:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688839168 00000100:00100000:1.0:1788837532.128960:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688839168 00000100:00100000:1.0:1788837532.129021:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1788837532.129032:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8299b52c-6950-430e-a077-88f6eaaeff37+22:2358:x1875731688839168:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837532.129049:0:14458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837532.129085:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2a00/0x843cbef8be30695f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf63 expref: 22 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837532.129115:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:1.0:1788837532.129120:0:14458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837532.129178:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8299b52c-6950-430e-a077-88f6eaaeff37+21:2358:x1875731688839168:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 148us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837532.129195:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1788837532.271995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837532.272169:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688839424 00000100:00100000:0.0:1788837532.272190:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688839424 00000100:00100000:0.0:1788837532.272349:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:0.0:1788837532.272363:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+21:14521:x1875731688839424:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:0.0:1788837532.272397:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837532.272418:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be30696d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf6a expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837532.272509:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306974 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837532.272524:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306974 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837532.272537:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306974 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837532.272548:0:14474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788837532.272682:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be30696d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf6a expref: 24 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837532.272700:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306974 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf6a expref: 23 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837532.272722:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:0.0:1788837532.272725:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837532.272729:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075c800, rc 0) 00000100:00100000:0.0:1788837532.272798:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+23:14521:x1875731688839424:12345-192.168.203.43@tcp:101:dd.0 Request processed in 438us (814us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788837532.272806:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:1.0:1788837532.280618:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837532.280755:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688839680 00000100:00100000:3.0:1788837532.280767:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688839680 00000100:00100000:3.0:1788837532.280827:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:3.0:1788837532.280838:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+23:14521:x1875731688839680:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:3.0:1788837532.280895:0:14472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788837532.280922:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be306974 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf6a expref: 23 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.280944:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f3e00/0x843cbef8be306927 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf4e expref: 22 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.280957:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:3.0:1788837532.280962:0:14472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837532.281157:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.281198:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.281213:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837532.281269:0:14472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788837532.281295:0:14472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7940d93 reply state 0000000061edcd25 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837532.281538:0:14472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837532.281677:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+24:14521:x1875731688839680:12345-192.168.203.43@tcp:36:dd.0 Request processed in 840us (1068us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788837532.281685:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000020:00080000:3.0:1788837532.281690:0:14472:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788837532.295834:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.295852:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.295860:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.295883:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837532.295888:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.295896:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.295913:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:2.0:1788837532.295916:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837532.295921:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837532.295928:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237200/0x843cbef8be306982 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837532.506349:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837532.506472:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688839936 00000100:00100000:3.0:1788837532.506482:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688839936 00000100:00100000:3.0:1788837532.506544:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:3.0:1788837532.506555:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+23:14521:x1875731688839936:12345-192.168.203.43@tcp:35:dd.0 00000100:00100000:3.0:1788837532.506786:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+24:14521:x1875731688839936:12345-192.168.203.43@tcp:35:dd.0 Request processed in 233us (485us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788837532.506806:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1788837532.519813:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708746368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837532.519884:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837532.519960:0:15159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708746368 00000100:00100000:0.0:1788837532.519968:0:15159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708746368 00000100:00100000:0.0:1788837532.520021:0:15159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837532.520030:0:15159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708746368:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788837532.520038:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788837532.520064:0:15159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788837532.520117:0:15159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875731708746368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837532.520125:0:15159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837532.520150:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708746368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837532.811200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837532.811419:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688840064 00000100:00100000:3.0:1788837532.811429:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688840064 00000100:00100000:3.0:1788837532.811501:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:3.0:1788837532.811510:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+24:14535:x1875731688840064:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:3.0:1788837532.811533:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837532.811570:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306989 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf71 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811639:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811654:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811666:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811686:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811693:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811700:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811784:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30699e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811793:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30699e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811800:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30699e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837532.811834:0:14473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788837532.811838:0:14473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788837532.811874:0:14473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30699e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811892:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30699e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811900:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811906:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811913:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811919:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837532.811923:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811931:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811943:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb4556d800) 00010000:00010000:3.0:1788837532.811947:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837532.811951:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811957:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306990 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811969:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811974:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811985:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811990:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837532.811993:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.811998:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.812006:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9acb4556db00) 00010000:00010000:3.0:1788837532.812008:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837532.812010:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.812016:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306997 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.812046:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306989 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf71 expref: 26 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.812059:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30699e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf71 expref: 25 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.812066:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:3.0:1788837532.812068:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837532.812071:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236c00, rc 0) 00000100:00100000:3.0:1788837532.812133:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+25:14535:x1875731688840064:12345-192.168.203.43@tcp:101:stat.0 Request processed in 623us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837532.812149:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1788837532.893993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837532.894104:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688840320 00000100:00100000:0.0:1788837532.894115:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688840320 00000100:00100000:0.0:1788837532.894193:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:0.0:1788837532.894203:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+25:14541:x1875731688840320:12345-192.168.203.43@tcp:36:truncate.0 00010000:00010000:0.0:1788837532.894589:0:15691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837532.894619:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236c00/0x843cbef8be30699e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf71 expref: 25 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837532.894642:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:0.0:1788837532.894660:0:15691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837532.894867:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837532.894881:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837532.894890:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837532.894940:0:15691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1788837532.894964:0:15691:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d2fa868 reply state 000000005de536b4 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837532.894972:0:15691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837532.895130:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+27:14541:x1875731688840320:12345-192.168.203.43@tcp:36:truncate.0 Request processed in 927us (1146us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788837532.895138:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000020:00080000:0.0:1788837532.895143:0:15691:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788837532.908393:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.908422:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.908432:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.908439:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837532.908445:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.908454:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.908477:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:3.0:1788837532.908481:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837532.908487:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.908494:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837532.965478:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837533.067854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837533.067985:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688840448 00000100:00100000:0.0:1788837533.068000:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688840448 00000100:00100000:0.0:1788837533.068094:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1788837533.068114:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+26:14556:x1875731688840448:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:0.0:1788837533.068147:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788837533.068267:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788837533.068300:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be3069ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf78 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068433:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068452:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068484:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068505:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068513:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068519:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068634:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068644:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068651:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837533.068695:0:14474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788837533.068700:0:14474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837533.068730:0:14474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068744:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068753:0:14474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068770:0:14474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068778:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068785:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837533.068790:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068798:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068814:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb4556d800) 00010000:00010000:0.0:1788837533.068817:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837533.068823:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068828:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c200/0x843cbef8be3069b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068844:0:14474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068849:0:14474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068855:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068859:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075c400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:0.0:1788837533.068869:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068876:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068884:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9acb50df5700) 00010000:00010000:0.0:1788837533.068887:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837533.068890:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068897:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068937:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be3069ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf78 expref: 28 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068953:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf78 expref: 27 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.068961:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:0.0:1788837533.068963:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837533.068966:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075c800, rc 0) 00000100:00100000:0.0:1788837533.069064:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+27:14556:x1875731688840448:12345-192.168.203.43@tcp:101:stat.0 Request processed in 959us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837533.069073:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:1.0:1788837533.199833:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837533.200402:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688840704 00000100:00100000:3.0:1788837533.200416:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688840704 00000100:00100000:3.0:1788837533.200496:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1788837533.200507:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+27:14566:x1875731688840704:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1788837533.200550:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837533.200585:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be3069c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf7f expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837533.200708:0:14472:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788837533.200869:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be3069c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf7f expref: 29 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.200887:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:3.0:1788837533.200891:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837533.200897:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be3069c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf7f expref: 29 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.200914:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236e00, rc 0) 00000100:00100000:3.0:1788837533.200993:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+28:14566:x1875731688840704:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 488us (1174us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788837533.201000:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1788837533.205732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837533.206255:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688840960 00000100:00100000:3.0:1788837533.206270:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688840960 00000100:00100000:3.0:1788837533.206375:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1788837533.206389:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb45d34450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+28:14566:x1875731688840960:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1788837533.206727:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb45d34450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+29:14566:x1875731688840960:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 341us (1010us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788837533.206736:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1788837533.293597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837533.293726:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688841216 00000100:00100000:0.0:1788837533.293745:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688841216 00000100:00100000:0.0:1788837533.293818:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1788837533.293836:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+29:14572:x1875731688841216:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837533.294069:0:14474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837533.294104:0:14474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be3069d6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf86 expref: -99 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.294255:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.294273:0:14474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf47 expref: 30 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.294283:0:14474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf78 expref: 30 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.294292:0:14474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.295503:0:14474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf78 expref: 30 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.295540:0:14474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf78 expref: 30 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837533.295559:0:14474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb7904a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14474:1875731708746496:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837533.295782:0:14474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf47 expref: 30 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.295793:0:14474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf47 expref: 30 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837533.295827:0:14474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79048a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14474:1875731708746624:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837533.296249:0:14474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f64fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837533.311472:0:14474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb7904a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14474:1875731708746496:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837533.311494:0:14474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79048a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14474:1875731708746624:192.168.203.43@tcp:104: 00010000:00010000:0.0:1788837533.311528:0:14474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837533.312403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837533.312641:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688841344 00000100:00100000:0.0:1788837533.312652:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688841344 00010000:00010000:0.0:1788837533.312705:0:14459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf78 expref: 31 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837533.312791:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1788837533.312803:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8299b52c-6950-430e-a077-88f6eaaeff37+31:2361:x1875731688841344:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837533.312823:0:14459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837533.312830:0:14459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf78 expref: 31 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.312854:0:14459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf78 expref: 31 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.312885:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf78 expref: 31 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.312906:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:0.0:1788837533.312930:0:14459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.312940:0:14459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.312947:0:14459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837533.313051:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8299b52c-6950-430e-a077-88f6eaaeff37+30:2361:x1875731688841344:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 242us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837533.313059:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1788837533.314987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837533.315076:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688841472 00000100:00100000:3.0:1788837533.315098:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688841472 00010000:00010000:3.0:1788837533.315186:0:14458:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf47 expref: 30 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837533.315235:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1788837533.315256:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8299b52c-6950-430e-a077-88f6eaaeff37+30:2361:x1875731688841472:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837533.315275:0:14458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837533.315283:0:14458:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf47 expref: 30 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.315333:0:14458:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf47 expref: 30 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.315371:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ca00/0x843cbef8be306912 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf47 expref: 30 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.315393:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:3.0:1788837533.315399:0:14458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.315409:0:14458:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.315417:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.315453:0:14458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837533.315528:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8299b52c-6950-430e-a077-88f6eaaeff37+29:2361:x1875731688841472:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 274us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837533.315536:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00010000:00010000:0.0:1788837533.315747:0:14474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.315757:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837533.315783:0:14474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788837533.316231:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be3069d6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf86 expref: 30 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.316257:0:14474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf86 expref: 29 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.316267:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:0.0:1788837533.316270:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837533.316274:0:14474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075c400, rc 0) 00000100:00100000:0.0:1788837533.316354:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+29:14572:x1875731688841216:12345-192.168.203.43@tcp:101:bash.0 Request processed in 22526us (22771us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788837533.316363:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:1.0:1788837533.323572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837533.327935:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688841728 00000100:00100000:3.0:1788837533.327958:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688841728 00000100:00100000:3.0:1788837533.328052:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:3.0:1788837533.328065:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+29:14572:x1875731688841728:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:2.0:1788837533.329000:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837533.329025:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837533.329040:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837533.329102:0:14472:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788837533.329131:0:14472:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000306caee4 reply state 00000000db2b8029 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837533.329141:0:14472:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837533.329398:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+32:14572:x1875731688841728:12345-192.168.203.43@tcp:36:bash.0 Request processed in 1332us (5837us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788837533.329431:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000020:00080000:2.0:1788837533.329438:0:14472:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788837533.335731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837533.335950:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688841856 00000100:00100000:0.0:1788837533.335964:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688841856 00000100:00100000:0.0:1788837533.336038:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1788837533.336051:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+32:14572:x1875731688841856:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837533.336083:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837533.336116:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf8d expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.336221:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf8d expref: 33 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.336259:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf8d expref: 33 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.336286:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:0.0:1788837533.336290:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837533.336295:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075c800, rc 0) 00000100:00100000:0.0:1788837533.336404:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+33:14572:x1875731688841856:12345-192.168.203.43@tcp:101:bash.0 Request processed in 355us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837533.336412:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00010000:00010000:1.0:1788837533.337733:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.337750:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.337759:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.337765:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837533.337771:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.337781:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.337810:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:1.0:1788837533.337813:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837533.337819:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.337826:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be3069eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837533.358479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837533.358839:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688841984 00000100:00100000:0.0:1788837533.358862:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688841984 00000100:00100000:0.0:1788837533.358946:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:0.0:1788837533.358959:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+32:14572:x1875731688841984:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1788837533.358987:0:15691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837533.359015:0:15691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be3069f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf94 expref: -99 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.359352:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.359380:0:15691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf86 expref: 33 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.359494:0:15691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.359540:0:15691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf86 expref: 33 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.359565:0:15691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf86 expref: 33 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837533.359582:0:15691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb79049180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15691:1875731708746752:192.168.203.43@tcp:104: 00000100:00100000:0.0:1788837533.359764:0:15691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837533.386890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837533.388198:0:15691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb79049180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15691:1875731708746752:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837533.388238:0:15691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837533.389141:0:16592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688842112 00000100:00100000:1.0:1788837533.389155:0:16592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688842112 00010000:00010000:1.0:1788837533.389226:0:16592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf86 expref: 34 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837533.389290:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1788837533.389505:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8299b52c-6950-430e-a077-88f6eaaeff37+34:2360:x1875731688842112:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837533.389548:0:16592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837533.389557:0:16592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf86 expref: 34 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.389582:0:16592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf86 expref: 34 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.389734:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c400/0x843cbef8be3069dd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf86 expref: 34 pid: 14474 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.389757:0:16592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:1.0:1788837533.389763:0:16592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.389776:0:16592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.389785:0:16592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837533.389815:0:16592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837533.390064:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8299b52c-6950-430e-a077-88f6eaaeff37+33:2360:x1875731688842112:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 761us (3189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837533.390074:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00010000:00010000:2.0:1788837533.390474:0:15691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837533.390484:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837533.390546:0:15691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788837533.390552:0:15691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837533.390576:0:15691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837533.390631:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c000/0x843cbef8be3069f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf94 expref: 34 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837533.390652:0:15691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf94 expref: 33 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837533.390660:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:2.0:1788837533.390663:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837533.390667:0:15691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075dc00, rc 0) 00000100:00100000:2.0:1788837533.390708:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+33:14572:x1875731688841984:12345-192.168.203.43@tcp:101:bash.0 Request processed in 31753us (32248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837533.390732:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1788837533.402050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837533.402295:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688842368 00000100:00100000:3.0:1788837533.402356:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688842368 00000100:00100000:3.0:1788837533.402453:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:3.0:1788837533.402466:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8299b52c-6950-430e-a077-88f6eaaeff37+32:14572:x1875731688842368:12345-192.168.203.43@tcp:103:bash.0 00010000:00010000:3.0:1788837533.402486:0:14458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788837533.402520:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075dc00/0x843cbef8be306a00 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf94 expref: 32 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.402548:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075c800/0x843cbef8be3069f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf8d expref: 31 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.402561:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5800) 00010000:00010000:3.0:1788837533.402574:0:14458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837533.403227:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8299b52c-6950-430e-a077-88f6eaaeff37+30:14572:x1875731688842368:12345-192.168.203.43@tcp:103:bash.0 Request processed in 760us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837533.403239:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:3.0:1788837533.412943:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837533.413253:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688842496 00000100:00100000:0.0:1788837533.413268:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688842496 00000100:00100000:0.0:1788837533.413372:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:0.0:1788837533.413484:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+30:14572:x1875731688842496:12345-192.168.203.43@tcp:58:bash.0 00010000:00010000:0.0:1788837533.413696:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.413718:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837533.413757:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788837533.419254:0:14473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837533.420231:0:14473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788837533.421008:0:14473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788837533.422131:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+30:14572:x1875731688842496:12345-192.168.203.43@tcp:58:bash.0 Request processed in 8737us (9190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837533.422166:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:0.0:1788837533.429572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837533.429962:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688842624 00000100:00100000:3.0:1788837533.429976:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688842624 00000100:00100000:3.0:1788837533.430718:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:3.0:1788837533.430739:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+30:14572:x1875731688842624:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1788837533.430769:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837533.430795:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306a0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbf9b expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.431818:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.432250:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306a0e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf9b expref: 31 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.432284:0:14472:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.432728:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306a0e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf9b expref: 31 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.432755:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5700) 00010000:00010000:3.0:1788837533.432759:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837533.432764:0:14472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306a0e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf9b expref: 31 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837533.432774:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75236e00, rc 0) 00000100:00100000:3.0:1788837533.433037:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+31:14572:x1875731688842624:12345-192.168.203.43@tcp:101:bash.0 Request processed in 2304us (3477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837533.433065:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00010000:00010000:2.0:1788837533.994271:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837534.008201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.008421:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688842752 00000100:00100000:1.0:1788837534.008434:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688842752 00000100:00100000:1.0:1788837534.008691:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:1.0:1788837534.008704:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+13:2360:x1875731688842752:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1788837534.008805:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4bdc0019-41b5-48db-a629-7682141160f9+13:2360:x1875731688842752:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 102us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837534.008814:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:1.0:1788837534.025089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.025141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.025187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.025351:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688842880 00000100:00100000:3.0:1788837534.025365:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688842880 00000100:00100000:3.0:1788837534.025436:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688843392 00000100:00100000:3.0:1788837534.025439:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688843392 00000100:00100000:3.0:1788837534.025462:0:16099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1788837534.025475:0:16099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8299b52c-6950-430e-a077-88f6eaaeff37+5:2360:x1875731688842880:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837534.025596:0:16099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8299b52c-6950-430e-a077-88f6eaaeff37+5:2360:x1875731688842880:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 124us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837534.025605:0:16099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1788837534.025628:0:16099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1788837534.025637:0:16099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c584049e-bfe6-4eea-8738-57e610314e70+5:2361:x1875731688843392:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837534.025676:0:16099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c584049e-bfe6-4eea-8738-57e610314e70+5:2361:x1875731688843392:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 40us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837534.025682:0:16099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00080000:1.0:1788837534.027065:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837534.027079:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837534.027254:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.027299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.027403:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688843008 00000100:00100000:3.0:1788837534.027415:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688843008 00000100:00100000:3.0:1788837534.027488:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688843264 00000100:00100000:3.0:1788837534.027492:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688843264 00000100:00100000:3.0:1788837534.027518:0:16099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1788837534.027529:0:16099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8299b52c-6950-430e-a077-88f6eaaeff37+5:2360:x1875731688843008:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1788837534.027616:0:16099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8299b52c-6950-430e-a077-88f6eaaeff37+5:2360:x1875731688843008:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 89us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837534.027625:0:16099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1788837534.027644:0:16099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:3.0:1788837534.027652:0:16099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c584049e-bfe6-4eea-8738-57e610314e70+5:2360:x1875731688843264:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:0.0:1788837534.027802:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837534.027806:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837534.028241:0:16099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c584049e-bfe6-4eea-8738-57e610314e70+5:2360:x1875731688843264:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 587us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837534.028250:0:16099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1788837534.028263:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688843136 00000100:00100000:2.0:1788837534.028271:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688843136 00000100:00100000:2.0:1788837534.028367:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:2.0:1788837534.028378:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c584049e-bfe6-4eea-8738-57e610314e70+11:2361:x1875731688843136:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1788837534.028418:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c584049e-bfe6-4eea-8738-57e610314e70+11:2361:x1875731688843136:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (3276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837534.028427:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00080000:1.0:1788837534.028658:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788837534.373604:0:14503:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788837534.373620:0:14503:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837534.373669:0:14503:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788837534.373676:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788837534.373854:0:14503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75242a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14503:1875731708746880:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837534.374069:0:14503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f732240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837534.386574:0:14503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75242a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14503:1875731708746880:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837534.395279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837534.395391:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688843520 00000100:00100000:2.0:1788837534.395405:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688843520 00000100:00100000:2.0:1788837534.395469:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1788837534.395481:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8299b52c-6950-430e-a077-88f6eaaeff37+31:14573:x1875731688843520:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788837534.395603:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8299b52c-6950-430e-a077-88f6eaaeff37+31:14573:x1875731688843520:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 Request processed in 123us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837534.395612:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1788837534.398441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837534.398580:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688843648 00000100:00100000:2.0:1788837534.398614:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688843648 00000100:00100000:2.0:1788837534.398689:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:2.0:1788837534.398702:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+31:14573:x1875731688843648:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788837534.398747:0:15691:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788837534.398905:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+31:14573:x1875731688843648:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 206us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837534.398914:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1788837534.403190:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837534.403814:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688843776 00000100:00100000:2.0:1788837534.403833:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688843776 00000100:00100000:2.0:1788837534.403922:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:2.0:1788837534.403935:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+31:14573:x1875731688843776:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788837534.404036:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.404059:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.404076:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409373:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409415:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409429:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409464:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409487:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409494:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837534.409538:0:14474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788837534.409543:0:14474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788837534.409556:0:14474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409568:0:14474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409575:0:14474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409581:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409587:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837534.409591:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409597:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409609:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:2.0:1788837534.409612:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837534.409616:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409632:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409649:0:14474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409655:0:14474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409660:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409665:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837534.409669:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409675:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409683:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9acb454ced00) 00010000:00010000:2.0:1788837534.409685:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837534.409688:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409694:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a1c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409708:0:14474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409713:0:14474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409724:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409729:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837534.409731:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409737:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409745:0:14474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5700) 00010000:00010000:2.0:1788837534.409747:0:14474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837534.409750:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.409756:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837534.410023:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+31:14573:x1875731688843776:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 6085us (6836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837534.410032:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:0.0:1788837534.428106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837534.428631:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688844032 00000100:00100000:2.0:1788837534.428652:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688844032 00000100:00100000:2.0:1788837534.428715:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:2.0:1788837534.428728:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb7904bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+31:14573:x1875731688844032:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837534.428748:0:15691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837534.428769:0:15691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbfa2 expref: -99 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.428895:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.428910:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.428921:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837534.428933:0:15691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788837534.429028:0:15691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.429036:0:15691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.429042:0:15691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.429048:0:15691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837534.429052:0:15691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.429059:0:15691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.429072:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5700) 00010000:00010000:2.0:1788837534.429075:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837534.429079:0:15691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.429096:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.429135:0:15691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a2a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfa2 expref: 33 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.429146:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9acb50df5a00) 00010000:00010000:2.0:1788837534.429148:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837534.429152:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfa2 expref: 33 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.429160:0:15691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2000, rc 0) 00000100:00100000:2.0:1788837534.429239:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb7904bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+32:14573:x1875731688844032:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 514us (1140us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788837534.429247:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1788837534.436467:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.436551:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688844160 00000100:00100000:3.0:1788837534.436561:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688844160 00000100:00100000:3.0:1788837534.436631:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:3.0:1788837534.436640:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+32:14573:x1875731688844160:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837534.436682:0:14473:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837534.436804:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+32:14573:x1875731688844160:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 164us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837534.436812:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:0.0:1788837534.439985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.440104:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688844416 00000100:00100000:3.0:1788837534.440114:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688844416 00000100:00100000:3.0:1788837534.440162:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:3.0:1788837534.440180:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+32:14573:x1875731688844416:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837534.440199:0:14472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837534.440465:0:14472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a3f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbfa9 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837534.441600:0:14472:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1788837534.441607:0:14472:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788837534.441771:0:14472:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788837534.442621:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306a46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.442640:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306a46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.442661:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306a46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.442745:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a3f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfa9 expref: 35 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.442779:0:14472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306a46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfa9 expref: 34 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.442789:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb4556db00) 00010000:00010000:3.0:1788837534.442792:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837534.442796:0:14472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb75237a00, rc 0) 00000100:00100000:3.0:1788837534.442864:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+34:14573:x1875731688844416:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 2685us (2887us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788837534.442872:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:0.0:1788837534.452298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.452543:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688844672 00000100:00100000:3.0:1788837534.452552:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688844672 00000100:00100000:3.0:1788837534.452605:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1788837534.452614:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+34:14573:x1875731688844672:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837534.452676:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837534.452761:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306a46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfa9 expref: 34 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452781:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb4556db00) 00010000:00010000:3.0:1788837534.452794:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837534.452814:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452825:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452834:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452862:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452869:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452876:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452939:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452946:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452952:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452958:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837534.452962:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452970:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452978:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb4556d800) 00010000:00010000:3.0:1788837534.452981:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837534.452985:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.452991:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306a54 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.453008:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.453014:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.453020:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.453025:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837534.453029:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.453035:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.453041:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc078cc5c (ffff9acb4556d900) 00010000:00010000:3.0:1788837534.453506:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837534.453514:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.453520:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306a5b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc078cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837534.453806:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb79633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+33:14573:x1875731688844672:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1189us (1512us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837534.453814:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1788837534.456998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837534.457152:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688844800 00000100:00100000:2.0:1788837534.457161:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688844800 00000100:00100000:2.0:1788837534.457230:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1788837534.457241:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb48b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+33:14573:x1875731688844800:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837534.457261:0:15691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837534.457282:0:15691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a62 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbfb0 expref: -99 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.457348:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.457374:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.457399:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.457531:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2000/0x843cbef8be306a62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb0 expref: 35 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.457549:0:15691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2200/0x843cbef8be306a69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb0 expref: 34 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.457558:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:0.0:1788837534.457561:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788837534.457564:0:15691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2200, rc 0) 00000100:00100000:0.0:1788837534.457622:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb48b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+34:14573:x1875731688844800:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 383us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837534.457636:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:1.0:1788837534.461522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837534.462517:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688845056 00000100:00100000:2.0:1788837534.462528:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688845056 00000100:00100000:2.0:1788837534.462607:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:2.0:1788837534.462617:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+34:14573:x1875731688845056:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788837534.462689:0:14474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.462705:0:14474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.462716:0:14474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837534.463142:0:14474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788837534.463153:0:14474:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 488313848653ns, next at 489313846513ns, rc = 0 00000004:00010000:2.0:1788837534.463243:0:14474:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006db77923 reply state 0000000066969c6e transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837534.463252:0:14474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837534.463368:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8299b52c-6950-430e-a077-88f6eaaeff37+36:14573:x1875731688845056:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 751us (1853us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788837534.463376:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00010000:00010000:3.0:1788837534.465292:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.465331:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.465339:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.465360:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb413f2800 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837534.465376:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.465384:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.465399:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:3.0:1788837534.465402:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788837534.465407:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.465413:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb413f2800/0x843cbef8be306a70 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837534.466996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.467202:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688845184 00000100:00100000:0.0:1788837534.467212:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688845184 00000100:00100000:0.0:1788837534.467263:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:0.0:1788837534.467272:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+35:14573:x1875731688845184:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837534.467294:0:15691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837534.467336:0:15691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbfb7 expref: -99 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.467398:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb7 expref: 36 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.467411:0:15691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb7 expref: 36 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.467429:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:0.0:1788837534.467432:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837534.467436:0:15691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075cc00, rc 0) 00000100:00100000:0.0:1788837534.467501:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+36:14573:x1875731688845184:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 229us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837534.467507:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:1.0:1788837534.470995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.471241:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688845312 00000100:00100000:0.0:1788837534.471250:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688845312 00000100:00100000:0.0:1788837534.471417:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1788837534.471428:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8299b52c-6950-430e-a077-88f6eaaeff37+5:2360:x1875731688845312:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788837534.472277:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8299b52c-6950-430e-a077-88f6eaaeff37+6:2360:x1875731688845312:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 847us (1285us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788837534.472300:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1788837534.479413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.479552:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688845568 00000100:00100000:3.0:1788837534.479561:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688845568 00000100:00100000:3.0:1788837534.479613:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1788837534.479623:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+36:14573:x1875731688845568:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788837534.479877:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+37:14573:x1875731688845568:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 255us (474us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788837534.479885:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1788837534.484719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.484807:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688845824 00000100:00100000:0.0:1788837534.484817:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688845824 00000100:00100000:0.0:1788837534.484880:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:0.0:1788837534.484889:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+37:14573:x1875731688845824:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837534.484993:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+37:14573:x1875731688845824:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837534.485004:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:1.0:1788837534.499773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.499864:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688845952 00000100:00100000:0.0:1788837534.499875:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688845952 00000100:00100000:0.0:1788837534.499926:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:0.0:1788837534.499935:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+37:14573:x1875731688845952:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837534.499952:0:15691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837534.499970:0:15691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a7e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbfbe expref: -99 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.500060:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be306a85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.500279:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be306a85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.500292:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be306a85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837534.500359:0:15691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788837534.500375:0:15691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be306a85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.500406:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a7e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfbe expref: 39 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.500422:0:15691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be306a85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfbe expref: 38 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.500431:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:0.0:1788837534.500434:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788837534.500437:0:15691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075ce00, rc 0) 00000100:00100000:2.0:1788837534.500635:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+38:14573:x1875731688845952:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 700us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837534.500652:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:1.0:1788837534.503240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.503877:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688846080 00000100:00100000:0.0:1788837534.503887:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688846080 00000100:00100000:0.0:1788837534.503940:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1788837534.503949:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8299b52c-6950-430e-a077-88f6eaaeff37+6:2361:x1875731688846080:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837534.503967:0:16665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837534.503987:0:16665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbfc5 expref: -99 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837534.504013:0:16665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7e9f, blocks: 0x1 00010000:00010000:0.0:1788837534.504032:0:16665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788837534.504370:0:16665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837534.504380:0:16665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfc5 expref: 7 pid: 16665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.504401:0:16665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfc5 expref: 7 pid: 16665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.504434:0:16665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb5075d000, rc 0) 00000100:00100000:2.0:1788837534.506695:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8299b52c-6950-430e-a077-88f6eaaeff37+7:2361:x1875731688846080:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 2735us (3452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837534.506708:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1788837534.511224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.511297:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688846336 00000100:00100000:0.0:1788837534.511341:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688846336 00000100:00100000:0.0:1788837534.511398:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:0.0:1788837534.511409:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+38:14573:x1875731688846336:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837534.511528:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+38:14573:x1875731688846336:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 120us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837534.511536:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1788837534.515543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837534.515684:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688846464 00000100:00100000:2.0:1788837534.515694:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688846464 00000100:00100000:2.0:1788837534.515749:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:2.0:1788837534.515759:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+38:14573:x1875731688846464:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788837534.587594:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000001:00080000:1.0:1788837534.587621:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:1.0:1788837534.587636:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788837534.587660:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1788837534.587668:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:1.0:1788837534.587688:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788837534.587809:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708747008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788837534.587873:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837534.587949:0:16099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708747008 00000100:00100000:1.0:1788837534.587957:0:16099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708747008 00000100:00100000:1.0:1788837534.588007:0:16099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837534.588016:0:16099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708747008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788837534.588189:0:16099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788837534.588193:0:16099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788837534.588196:0:16099:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788837534.588198:0:16099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788837535 -> 1788837535 00002000:00010000:1.0:1788837534.588201:0:16099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788837534.588237:0:16099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1875731708747008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (364us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788837534.588244:0:16099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788837534.588262:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788837534.588291:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9acb44fa1f80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788837534.588296:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708747008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788837534.588697:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+13:14573:x1875731688846464:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 72936us (73160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837534.588706:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:1.0:1788837534.601344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.601865:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688846592 00000100:00100000:0.0:1788837534.601876:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688846592 00000100:00100000:0.0:1788837534.601935:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1788837534.601945:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8299b52c-6950-430e-a077-88f6eaaeff37+7:2360:x1875731688846592:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788837534.602058:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8299b52c-6950-430e-a077-88f6eaaeff37+7:2360:x1875731688846592:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 113us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837534.602064:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:1.0:1788837534.609456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.610574:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688846848 00000100:00100000:0.0:1788837534.610586:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688846848 00000100:00100000:0.0:1788837534.610651:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:0.0:1788837534.610662:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+13:14573:x1875731688846848:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837534.610713:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837534.610739:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075ce00/0x843cbef8be306a85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfbe expref: 13 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.610761:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:0.0:1788837534.610780:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837534.610810:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.610825:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.610835:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837534.611083:0:14473:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb623dfe reply state 00000000fc0e920a transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837534.611092:0:14473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837534.611201:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+14:14573:x1875731688846848:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 541us (1752us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788837534.611208:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00010000:00010000:2.0:1788837534.624252:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.624271:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.624279:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.624285:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075da00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:2.0:1788837534.624290:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.624298:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.624350:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:2.0:1788837534.624354:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837534.624358:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.624382:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075da00/0x843cbef8be306a93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837534.626736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837534.626978:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688846976 00000100:00100000:2.0:1788837534.626988:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688846976 00000100:00100000:2.0:1788837534.627045:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:2.0:1788837534.627055:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8299b52c-6950-430e-a077-88f6eaaeff37+7:14573:x1875731688846976:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837534.627077:0:16665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837534.627096:0:16665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbfcc expref: -99 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.627124:0:16665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfc5 expref: 8 pid: 16665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.627134:0:16665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837534.627138:0:16665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837534.627144:0:16665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 8 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.627184:0:16665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfc5 expref: 8 pid: 16665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.627204:0:16665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfc5 expref: 8 pid: 16665 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837534.627218:0:16665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75240a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16665:1875731708747136:192.168.203.43@tcp:104: 00000100:00100000:2.0:1788837534.627333:0:16665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f732c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837534.638896:0:16665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75240a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:16665:1875731708747136:192.168.203.43@tcp:104: 00010000:00010000:2.0:1788837534.638930:0:16665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 8 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.638956:0:16665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f3c00, rc 0) 00000100:00100000:2.0:1788837534.639016:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8299b52c-6950-430e-a077-88f6eaaeff37+8:14573:x1875731688846976:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 11961us (12288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837534.639025:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1788837534.644198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837534.644297:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688847104 00000100:00100000:0.0:1788837534.644343:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688847104 00010000:00010000:0.0:1788837534.644392:0:14459:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfc5 expref: 8 pid: 16665 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837534.644425:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1788837534.644435:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8299b52c-6950-430e-a077-88f6eaaeff37+8:2360:x1875731688847104:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837534.644450:0:14459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837534.644472:0:14459:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfc5 expref: 8 pid: 16665 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.644492:0:14459:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfc5 expref: 8 pid: 16665 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.644529:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099a9f62c/0x843cbef8be306a8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfc5 expref: 8 pid: 16665 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.644546:0:14459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837534.644550:0:14459:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837534.644556:0:14459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 7 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.644566:0:14459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 7 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837534.644605:0:14459:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 7 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837534.644619:0:14459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74eff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14459:1875731708747264:192.168.203.43@tcp:105: 00000100:00100000:0.0:1788837534.644705:0:14459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb4f43db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837534.649065:0:14459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74eff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14459:1875731708747264:192.168.203.43@tcp:105: 00010000:00010000:0.0:1788837534.649103:0:14459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837534.649172:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8299b52c-6950-430e-a077-88f6eaaeff37+7:2360:x1875731688847104:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 4730us (4974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837534.649184:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1788837534.651609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.651702:0:15157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688847232 00000100:00100000:1.0:1788837534.651711:0:15157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688847232 00000100:00100000:1.0:1788837534.651764:0:15157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1788837534.651774:0:15157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8299b52c-6950-430e-a077-88f6eaaeff37+7:2361:x1875731688847232:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788837534.651975:0:15157:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788837534.651979:0:15157:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788837534 00002000:00010000:1.0:1788837534.651981:0:15157:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788837532 00002000:00010000:1.0:1788837534.651983:0:15157:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788837535 -> 1788837534 00002000:00010000:1.0:1788837534.651985:0:15157:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788837534.652054:0:15157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8299b52c-6950-430e-a077-88f6eaaeff37+8:2361:x1875731688847232:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 279us (457us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788837534.652062:0:15157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1788837534.656272:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.656776:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688847360 00000100:00100000:1.0:1788837534.656795:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688847360 00000100:00100000:1.0:1788837534.656853:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1788837534.656864:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8299b52c-6950-430e-a077-88f6eaaeff37+8:2360:x1875731688847360:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788837534.656905:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.656925:0:15158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 8 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.656934:0:15158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837534.656939:0:15158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837534.656943:0:15158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.656975:0:15158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 8 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.657008:0:15158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 8 pid: 16665 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837534.657023:0:15158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15158:1875731708747392:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837534.657180:0:15158:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837534.663521:0:15158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15158:1875731708747392:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837534.663550:0:15158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837534.671415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.671509:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688847488 00000100:00100000:1.0:1788837534.671519:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688847488 00010000:00010000:1.0:1788837534.671559:0:14457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 9 pid: 16665 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837534.671600:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:1.0:1788837534.671610:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8299b52c-6950-430e-a077-88f6eaaeff37+9:2361:x1875731688847488:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837534.671626:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837534.671645:0:14457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 9 pid: 16665 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.671665:0:14457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 9 pid: 16665 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.671705:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd8b9999/0x843cbef8be306a9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfcc expref: 9 pid: 16665 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.671722:0:14457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837534.671726:0:14457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837534.671732:0:14457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.671742:0:14457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.671777:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837534.671822:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8299b52c-6950-430e-a077-88f6eaaeff37+8:2361:x1875731688847488:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 213us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837534.671829:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00010000:00010000:2.0:1788837534.672613:0:15158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.672627:0:15158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.672654:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.672662:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.672669:0:15158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.672676:0:15158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576000 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837534.672690:0:15158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.672700:0:15158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.672718:0:15158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.672726:0:15158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054574e89/0x843cbef8be306aa1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837534.672787:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8299b52c-6950-430e-a077-88f6eaaeff37+7:2360:x1875731688847360:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 15924us (16522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837534.672795:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1788837534.675857:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.675920:0:15691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688847744 00000100:00100000:1.0:1788837534.675929:0:15691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688847744 00000100:00100000:1.0:1788837534.675978:0:15691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1788837534.675987:0:15691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+13:14573:x1875731688847744:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788837534.676069:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.676091:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.676102:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.676504:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.676517:0:15691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb7 expref: 14 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.676524:0:15691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.676557:0:15691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb7 expref: 14 pid: 15691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.676576:0:15691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb7 expref: 14 pid: 15691 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837534.676588:0:15691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15691:1875731708747520:192.168.203.43@tcp:104: 00000100:00100000:1.0:1788837534.676667:0:15691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5077d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837534.680549:0:15691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15691:1875731708747520:192.168.203.43@tcp:104: 00010000:00010000:1.0:1788837534.680581:0:15691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837534.683191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.683288:0:16592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688847872 00000100:00100000:1.0:1788837534.683297:0:16592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688847872 00010000:00010000:1.0:1788837534.683369:0:16592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb7 expref: 15 pid: 15691 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837534.683408:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1788837534.683430:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75240e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8299b52c-6950-430e-a077-88f6eaaeff37+15:2361:x1875731688847872:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837534.683445:0:16592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837534.683452:0:16592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb7 expref: 15 pid: 15691 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.683470:0:16592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb7 expref: 15 pid: 15691 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.683490:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075cc00/0x843cbef8be306a77 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfb7 expref: 15 pid: 15691 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.683504:0:16592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:1.0:1788837534.683509:0:16592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.683519:0:16592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.683527:0:16592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.683557:0:16592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837534.683602:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75240e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8299b52c-6950-430e-a077-88f6eaaeff37+14:2361:x1875731688847872:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 174us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837534.683610:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00010000:00010000:2.0:1788837534.683721:0:15691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.683729:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837534.683902:0:15691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788837534.684063:0:15691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788837534.684108:0:15691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788837534.684195:0:15691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75240700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15691:1875731708747648:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788837534.684276:0:15691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837534.684358:0:15691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb7f732000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837534.684749:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708747648 00000100:00100000:1.0:1788837534.684755:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708747648 00000100:00100000:1.0:1788837534.684794:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837534.684802:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb75240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15691:x1875731708747648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788837534.684881:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15691:x1875731708747648:12345-0@lo:1000:mdt00_003.0 Request processed in 79us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837534.684888:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837534.684925:0:15691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75240700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15691:1875731708747648:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788837534.686816:0:15691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788837534.686902:0:15691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15691:1875731708747776:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788837534.686956:0:15691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837534.686978:0:15691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d33d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788837534.687210:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708747776 00000100:00100000:3.0:1788837534.687217:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708747776 00000100:00100000:3.0:1788837534.687268:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837534.687276:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15691:x1875731708747776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788837534.687597:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15691:x1875731708747776:12345-0@lo:1000:mdt00_003.0 Request processed in 320us (639us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788837534.687605:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837534.688939:0:15691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15691:1875731708747776:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788837534.688981:0:15691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.688991:0:15691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.688999:0:15691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689005:0:15691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576600 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837534.689010:0:15691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689019:0:15691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689582:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:1.0:1788837534.689587:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837534.689594:0:15691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689619:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306aaf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689652:0:15691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689658:0:15691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689665:0:15691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689670:0:15691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb5075de00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837534.689673:0:15691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689679:0:15691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689688:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5700) 00010000:00010000:1.0:1788837534.689690:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837534.689697:0:15691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306a0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf9b expref: 17 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689709:0:15691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306a0e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf9b expref: 17 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689718:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306a0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf9b expref: 17 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.689760:0:15691:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236e00/0x843cbef8be306a0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbf9b expref: 17 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837534.689773:0:15691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb44fa0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15691:1875731708747904:192.168.203.43@tcp:105: 00000100:00100000:1.0:1788837534.689850:0:15691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9acb5d33d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788837534.697434:0:15691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb44fa0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15691:1875731708747904:192.168.203.43@tcp:105: 00010000:00010000:1.0:1788837534.697466:0:15691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697478:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb5075de00/0x843cbef8be306a07 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697512:0:15691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697525:0:15691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697536:0:15691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697547:0:15691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697554:0:15691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697560:0:15691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697582:0:15691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f576000 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837534.697587:0:15691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697595:0:15691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697605:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5700) 00010000:00010000:1.0:1788837534.697608:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837534.697612:0:15691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697618:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576000/0x843cbef8be306ab6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697627:0:15691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697634:0:15691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697640:0:15691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697644:0:15691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb7f577400 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:1.0:1788837534.697647:0:15691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697653:0:15691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697668:0:15691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5700) 00010000:00010000:1.0:1788837534.697670:0:15691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788837534.697673:0:15691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.697679:0:15691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f577400/0x843cbef8be306aa8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837534.697897:0:15691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb75240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8299b52c-6950-430e-a077-88f6eaaeff37+17:14573:x1875731688847744:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 21909us (22047us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788837534.697906:0:15691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000020:00080000:1.0:1788837534.697913:0:15691:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788837534.698286:0:14503:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788837534.698292:0:14503:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837534.698354:0:14503:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788837534.698360:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788837534.709774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.710204:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688848000 00000100:00100000:3.0:1788837534.710213:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688848000 00000100:00100000:3.0:1788837534.710264:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1788837534.710273:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+17:14572:x1875731688848000:12345-192.168.203.43@tcp:49:bash.0 00000100:00100000:3.0:1788837534.710437:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+17:14572:x1875731688848000:12345-192.168.203.43@tcp:49:bash.0 Request processed in 164us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837534.710444:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1788837534.719773:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.719850:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688848256 00000100:00100000:3.0:1788837534.719860:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688848256 00000100:00100000:3.0:1788837534.719916:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1788837534.719926:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+17:14573:x1875731688848256:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788837534.720775:0:14476:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788837534.720870:0:14476:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1788837534.720909:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.720926:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.720936:0:14476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.720952:0:14476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.720959:0:14476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.720966:0:14476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.722175:0:14476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837534.722293:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+19:14573:x1875731688848256:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 2364us (2526us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1788837534.722318:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000020:00080000:3.0:1788837534.722323:0:14476:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788837534.726664:0:14460:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837534.726679:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.726690:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236200 already unused, calling callback (ffffffffc1558420) 00010000:00010000:2.0:1788837534.726695:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.726705:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.726723:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9acb454ced00) 00010000:00010000:2.0:1788837534.726726:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788837534.726731:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.726737:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306abd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.726755:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837534.726757:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837534.726759:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837534.739532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1788837534.739692:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688848384 00000100:00100000:2.0:1788837534.739703:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688848384 00000100:00100000:2.0:1788837534.739806:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1788837534.739816:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8299b52c-6950-430e-a077-88f6eaaeff37+7:14572:x1875731688848384:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1788837534.739849:0:16665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837534.739871:0:16665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e6dc7e/0x843cbef8be306ac4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbfd3 expref: -99 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837534.739897:0:16665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f7e9e, atime: 0x6a9f7e9c, ctime: 0x6a9f7e9e, blocks: 0x1 00010000:00010000:2.0:1788837534.739919:0:16665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788837534.739924:0:16665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837534.739934:0:16665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e6dc7e/0x843cbef8be306ac4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfd3 expref: 8 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.739950:0:16665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e6dc7e/0x843cbef8be306ac4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfd3 expref: 8 pid: 16665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837534.739962:0:16665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb413f2400, rc 0) 00000100:00100000:2.0:1788837534.740019:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8299b52c-6950-430e-a077-88f6eaaeff37+8:14572:x1875731688848384:12345-192.168.203.43@tcp:101:bash.0 Request processed in 204us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837534.740026:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1788837534.743715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.743803:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688848640 00000100:00100000:3.0:1788837534.743813:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688848640 00000100:00100000:3.0:1788837534.743962:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:3.0:1788837534.743973:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8299b52c-6950-430e-a077-88f6eaaeff37+19:14572:x1875731688848640:12345-192.168.203.43@tcp:35:bash.0 00000001:00080000:3.0:1788837534.744246:0:14475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1788837534.744578:0:14475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1788837534.744685:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8299b52c-6950-430e-a077-88f6eaaeff37+22:14572:x1875731688848640:12345-192.168.203.43@tcp:35:bash.0 Request processed in 712us (977us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1788837534.744693:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000020:00080000:3.0:1788837534.744697:0:14475:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788837534.870207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.870343:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688848896 00000100:00100000:1.0:1788837534.870353:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688848896 00000100:00100000:1.0:1788837534.870419:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1788837534.870429:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+22:14583:x1875731688848896:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1788837534.870452:0:14473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837534.870587:0:14473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306acb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb7b11a20dbbbfda expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837534.870739:0:14473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788837534.870866:0:14473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306acb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfda expref: 24 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.870880:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9acb454cee00) 00010000:00010000:1.0:1788837534.870883:0:14473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837534.870903:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb7f576600/0x843cbef8be306acb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0xbb7b11a20dbbbfda expref: 24 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837534.870917:0:14473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9acb7f576600, rc 0) 00000100:00100000:1.0:1788837534.871012:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8299b52c-6950-430e-a077-88f6eaaeff37+23:14583:x1875731688848896:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 584us (815us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1788837534.871020:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1788837534.882590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1788837534.882798:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688849024 00000100:00100000:3.0:1788837534.882808:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688849024 00000100:00100000:3.0:1788837534.882866:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1788837534.882877:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+23:14583:x1875731688849024:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:3.0:1788837534.882960:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.882978:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.882989:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883003:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883011:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883018:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883290:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883299:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883336:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837534.883376:0:14472:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883388:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883404:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883411:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883417:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837534.883421:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883428:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883440:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9acb4556d800) 00010000:00010000:3.0:1788837534.883443:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837534.883448:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883455:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236a00/0x843cbef8be306ad9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883467:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883473:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883478:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883483:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75237a00 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837534.883492:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883499:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883507:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9acb4556d900) 00010000:00010000:3.0:1788837534.883510:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837534.883513:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883518:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75237a00/0x843cbef8be306ae0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883536:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883543:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883549:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883554:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9acb75236200 already unused, calling callback (ffffffffc1faa4f0) 00010000:00010000:3.0:1788837534.883557:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883563:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883570:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9acb50df5700) 00010000:00010000:3.0:1788837534.883573:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837534.883584:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837534.883590:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9acb75236200/0x843cbef8be306ae7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14472 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837534.883668:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8299b52c-6950-430e-a077-88f6eaaeff37+23:14583:x1875731688849024:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 793us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837534.883677:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:0.0:1788837534.892634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837534.892926:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688849280 00000100:00100000:1.0:1788837534.892936:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688849280 00000100:00100000:1.0:1788837534.893029:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:1.0:1788837534.893049:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+23:14583:x1875731688849280:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1788837534.893300:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8299b52c-6950-430e-a077-88f6eaaeff37+24:14583:x1875731688849280:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 252us (674us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1788837534.893353:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00010000:00010000:3.0:1788837535.013527:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837536.039084:0:15695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837536.103751:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837536.103774:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb74e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708748032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837536.103852:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837536.104138:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708748160:0@lo:400:kworker.0 00000100:00100000:0.0:1788837536.104183:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837536.104224:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708748672:0@lo:400:kworker.0 00000100:00100000:0.0:1788837536.104248:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837536.104265:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837536.104270:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708748544:0@lo:400:kworker.0 00000100:00100000:0.0:1788837536.104291:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837536.104480:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708748288:0@lo:400:kworker.0 00000100:00100000:3.0:1788837536.104513:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837536.104542:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837536.104548:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708748416:0@lo:400:kworker.0 00000100:00100000:3.0:1788837536.104570:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837536.104599:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708748672 00000100:00100000:3.0:1788837536.104605:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708748672 00000100:00100000:3.0:1788837536.104660:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708748544 00000100:00100000:3.0:1788837536.104664:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708748544 00000100:00100000:3.0:1788837536.104679:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708748416 00000100:00100000:3.0:1788837536.104681:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708748416 00000100:00100000:3.0:1788837536.104695:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837536.104702:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708748672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837536.104754:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875731708748672:12345-0@lo:400:kworker.0 Request processed in 52us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837536.104762:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837536.104779:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837536.104785:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708748544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837536.104811:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875731708748544:12345-0@lo:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837536.104829:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837536.104841:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837536.104846:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708748416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837536.104894:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875731708748416:12345-0@lo:400:kworker.0 Request processed in 48us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837536.104900:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837536.104934:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875731708748416:0@lo:400:kworker.0 00000100:00100000:3.0:1788837536.104962:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1875731708748544:0@lo:400:kworker.0 00000100:00100000:3.0:1788837536.104971:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1875731708748672:0@lo:400:kworker.0 00000100:00100000:2.0:1788837536.105149:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708748160 00000100:00100000:2.0:1788837536.105167:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708748160 00000100:00100000:2.0:1788837536.105206:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788837536.105222:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb42d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3314:x1875731708748160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837536.105262:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb42d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fbef8f-8952-49e4-a88d-774a3e8128a4+19:3314:x1875731708748160:12345-0@lo:400:kworker.0 Request processed in 49us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837536.105268:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788837536.105720:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fbef8f-8952-49e4-a88d-774a3e8128a4:3314:1875731708748160:0@lo:400:kworker.0 00000100:00100000:0.0:1788837536.107452:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708748288 00000100:00100000:0.0:1788837536.107465:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708748288 00000100:00100000:0.0:1788837536.107534:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788837536.107555:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1875731708748288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837536.107653:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1875731708748288:12345-0@lo:400:kworker.0 Request processed in 110us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837536.107660:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837536.107889:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708748032 00000100:00100000:1.0:1788837536.107894:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708748032 00000100:00100000:1.0:1788837536.108003:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837536.108011:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708748032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837536.108041:0:15160:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788837536.108090:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875731708748032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837536.108097:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788837536.108126:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837536.108130:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837536.108133:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837536.108213:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1875731708748288:0@lo:400:kworker.0 00000100:00100000:3.0:1788837536.108436:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb74e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1875731708748032:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788837536.648940:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1788837536.648960:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1788837536.648969:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1788837536.648973:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:02000400:2.0:1788837536.781944:0:16743:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788837537.062514:0:14460:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837537.594419:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1788837537.594469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1788837537.594574:0:15158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688849536 00000100:00100000:1.0:1788837537.594585:0:15158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688849536 00000100:00100000:1.0:1788837537.594663:0:15158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:1.0:1788837537.594675:0:15158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8299b52c-6950-430e-a077-88f6eaaeff37+6:2360:x1875731688849536:12345-192.168.203.43@tcp:16:kworker.0 00000100:00100000:1.0:1788837537.594793:0:15158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8299b52c-6950-430e-a077-88f6eaaeff37+6:2360:x1875731688849536:12345-192.168.203.43@tcp:16:kworker.0 Request processed in 120us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837537.594801:0:15158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1788837537.595000:0:15161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731688849408 00000100:00100000:2.0:1788837537.595005:0:15161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731688849408 00002000:00100000:2.0:1788837537.595044:0:15161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9acb74efd500 x1875731688849408/t0(0) o4->8299b52c-6950-430e-a077-88f6eaaeff37@192.168.203.43@tcp:193/0 lens 504/0 e 0 to 0 dl 1788837548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788837537.595055:0:15161:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74efd500 with x1875731688849408 ext(0->8) 00002000:00010000:2.0:1788837537.595061:0:15161:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb74efd500 00000100:00100000:2.0:1788837537.595087:0:15161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1788837537.595095:0:15161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb74efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8299b52c-6950-430e-a077-88f6eaaeff37+6:2360:x1875731688849408:12345-192.168.203.43@tcp:4:bash.0 00000100:00100000:2.0:1788837537.595654:0:15161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb74efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8299b52c-6950-430e-a077-88f6eaaeff37+8:2360:x1875731688849408:12345-192.168.203.43@tcp:4:bash.0 Request processed in 558us (1246us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788837537.595664:0:15161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00002000:00100000:2.0:1788837537.595671:0:15161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9acb74efd500 x1875731688849408/t8589934598(0) o4->8299b52c-6950-430e-a077-88f6eaaeff37@192.168.203.43@tcp:193/0 lens 504/448 e 0 to 0 dl 1788837548 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788837537.595679:0:15161:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9acb74efd500 with x1875731688849408 ext(0->8) 00002000:00010000:2.0:1788837537.595683:0:15161:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9acb74efd500 00000100:00080000:3.0:1788837537.596072:0:14468:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837537.637815:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837537.637840:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9acb75243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708748800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837537.637924:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837537.638297:0:15160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875731708748800 00000100:00100000:2.0:1788837537.638335:0:15160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875731708748800 00000100:00100000:2.0:1788837537.638424:0:15160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837537.638434:0:15160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9acb44fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708748800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837537.638456:0:15160:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788837537.638511:0:15160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9acb44fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875731708748800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837537.638534:0:15160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837537.638599:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788837537.638605:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9acb44fa1f80, transno 8589934595 00000004:00080000:1.0:1788837537.638624:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788837537.638651:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9acb75243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1875731708748800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837538.086652:0:14461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29551 lines, 29551 kept, 0 dropped, 0 bad.